• Hub 3 - Clrghouz updates

    From deon@21:2/116 to All on Tuesday, February 24, 2026 14:52:07
    Howdy,

    I've been doing smoe work on clrghouz the last week or two, and I started rolling out those updates over the last week.

    I've basically optimised the message store, changing compression from zstd to brotli, as well as changing how its stored in the DB - which looks like has bought me a 60-70% reduction in message stoage - yay :)

    I also reworked how packets are parsed, that I think gives me a performance boost now, but primarily enables me to skip past bad messages in a packet and hopefully just throw away that one bad one.

    Unfortunately, I broke a few things along the way, and I'm now chasing the final bugs hopefully. Every now and again I see an exception in the logs that I fix, and those exceptions are not happening as often now.

    The DB will be going through a conversion over the next few hours (got 1m messages in there!) to take advantage of that space, before I upgrade it to a later version (when thats done).

    If you see something odd, please let me know.


    ...лоеп
    --- SBBSecho 3.29-Linux
    * Origin: I'm playing with ANSI+videotex - wanna play too? (21:2/116)
  • From Warpslide@21:3/110 to deon on Tuesday, February 24, 2026 06:01:12
    On 24 Feb 2026, deon said the following...

    If you see something odd, please let me know.

    I have seen quite a few dupes on my side lately, a lot of them are ibbslastcall messages, others include:

    MSGID: 21:4/148@fsxnet 699c29b8 from "Roon" in FSX_TST
    MSGID: 21:4/131 0192ef2d from "Wrong Number Family BBS'" in FSX_ADS


    This last batch all seem to be from Hub 4, so may not be Clrghouz related.


    Jay

    ... The cause of problems are solutions!

    --- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
    * Origin: Northern Realms (21:3/110)
  • From deon@21:2/116 to Warpslide on Tuesday, February 24, 2026 23:21:17
    Re: Re: Hub 3 - Clrghouz updates
    By: Warpslide to deon on Tue Feb 24 2026 06:01 am

    Howdy,

    I have seen quite a few dupes on my side lately, a lot of them are ibbslastcall messages, others include:

    MSGID: 21:4/148@fsxnet 699c29b8 from "Roon" in FSX_TST
    MSGID: 21:4/131 0192ef2d from "Wrong Number Family BBS'" in FSX_ADS

    This last batch all seem to be from Hub 4, so may not be Clrghouz related.

    They were likely clrghouz.

    I discovered clrghouz wasnt processing the seen-by (or path/via lines) from messages (echomail & netmail), so its likely it sent them out again to the hubs.

    Should be good now though, fixed it this morning...

    If they keep coming, please let me know...


    ...лоеп
    --- SBBSecho 3.29-Linux
    * Origin: I'm playing with ANSI+videotex - wanna play too? (21:2/116)