• Tilde.team's Netnews server is now brought up to speed

    From xwindows@xwindows@tilde.club to tilde.team on Tue Aug 10 10:29:20 2021
    Hello folks,

    It's quite a while since the last Netnews-related announcement
    on the network: and I'm glad to (a bit belated) announce that Tilde.team
    is now a fully-functional node in Tildeverse Netnews once again;
    fully verified on 2 August 2021, that it provides full post history
    in all `tilde.*` newsgroups, matching with other servers in the network.

    So, Tilde.team's members who would like to participate in Netnews
    directly from Tilde.team's own server, experiment with posting
    from shell, SSH tunnel, or reading "offline" from server-local news spool;
    you may now do so in confidence.

    %<-----

    For people who are curious of "why?" On 30 July 2021 [1], there were
    two problems discovered on Tilde.team's NNTP server: one was
    a de-synchronization due to its changed IP address, which means
    other servers couldn't send new posts to it (but new posts made there
    would reach other servers normally).

    The NNTP link being specified by IP(v4) address was a leftover artifact of
    a (successful) experiment to work around INN2's resource leak in its IPv6 newsreader request handling around 13 January 2021 [2]. When Tilde.team subsequently changed its IP address on 12 April 2021 [3],
    the inevitable happened. ~tomasino fixed it soon after this was reported [4], and the missing chunks of newer posts sorted themselves.

    The second problem however, was the complete absence of posts history
    beyond certain date into the past. This originated back to the first days
    of current incarnation of Netnews service on Tilde.team. The server
    had been set up, networked, and could read and post properly
    (to ~ben's credit); but the last step needed in small NNTP networks
    like Tildeverse Netnews was filling the server with preexisting posts, otherwise users connected there wouldn't see any posts older
    than the day that the server got first connected to its peers.

    There are multiple ways to do this; the problem was that back then,
    only one approach properly tested on Tildeverse Netnews was the one
    I used at Tilde.club [5]. However, this way does not work on Tilde.team
    because its NNTP setup has tighter security policy; and no one had
    a complete idea how to make other approaches work.

    So it got postponed, and... forgotten. (How embarrassing)

    Anyway, back to the present; soon after the issue got pointed out,
    and I started looking into it, I came across a way to get this
    long-postponed task to work out by chance... from a manual of other
    USENET software I used as a part of investigation [6]; but this way
    of history feed-up has to be initiated from an adjacent server
    (Cosmic.voyage) by an administrator there (~tomasino), and Tilde.team's
    NNTP server configuration must be adjusted to take them.

    After some back and forth with ~tomasino to conduct test run of the process yielded good result [7]; I asked ~khuxkm to apply settings change
    on Tilde.team [8], then back to ~tomasino to initiate the full procedure,
    which completed successfully. [9]

    Finally, I did a full `tilde.*` postings history comparison against Cosmic.voyage (a distribution point in Tildeverse Netnews)
    as a re-verification; which they turned out fully matched,
    and that concluded the fixup. [10]

    %<-----

    And on the last note, if anyone spotted problems on Netnews servers here,
    don't forget to give some shout on #netnews channel of Tildeverse IRC too (dropping a line to my email also works, but it might not be as fast),
    so it could be looked into as soon as the time allows.

    Wish you a good old Netnews time,
    ~xwindows
    (Tilde.club's unofficial Netnews wrangler)


    P.S. For the record, current Tildeverse Netnews NNTP topology
    is as follows:

    news.tilde.club/
    news.tildeverse.org <-------. ,-------> yourtilde.com
    (public gateway) | | (public gateway)
    ^ v v
    | cosmic.voyage
    | *A (distribution point)
    | ^ ^
    | | |
    tilde.team <--------------' '-------> baud.baby
    (private server)

    *A : This path is one-way.

    (Servers that are not explicitly denoted private or public here
    are open to newsreading requests from the Internet in read-only fashion)

    -----

    [1] "~team nntp doesn't seem to sync" [2021-07-30T04:05:46Z]
    <news:sdvtqq$282fr$2@tilde.tilde.team>
    <nntp://news.tilde.club/tilde.team/11>

    [2] This happened on Tildeverse IRC's #netnews channel, from
    2021-01-13T11:41Z to 2021-01-13T21:22Z.

    [3] ~ben announced Tilde.team VM relocation (which also entails IP address
    change) in #team channel of Tildeverse IRC on 2021-04-11T19:53Z,
    which completed on 2021-04-12T00:20Z.

    [4] "Re: ~team nntp doesn't seem to sync" [2021-07-30T09:43:04Z]
    <news:slrnsg7id8.1mvnm.tomasino@cosmic.voyage>
    <nntp://news.tilde.club/tilde.team/16>

    [5] "A copycat recipe for suck-feeding from Tildeverse NNTP newspool"
    [2020-09-25T08:58:58Z]
    <news:alpine.LFD.2.23.451.2009251556480.2030507@tilde.club>
    <nntp://news.tilde.club/tilde.club/23>

    [6] `suck` program is written to accommodate various method of news spool
    feed-up: one of them (direct NNTP `IHAVE` push) was the method I used
    on Tilde.club [5], but there are many others, including `innfeed`-based
    and `innxmit`-based method; last of which was the one I have chosen
    to apply in fixing Tilde.team, sans the use of `suck` program itself.

    [7] This happened on Tildeverse IRC's #netnews channel, from
    2021-08-01T01:27Z to 2021-08-01T12:12Z.

    [8] This happened on Tildeverse IRC's #team channel, from
    2021-08-02T01:52Z to 2021-08-02T02:26Z.

    [9] This happened on Tildeverse IRC's #netnews channel, from
    2021-08-02T03:57Z to 2021-08-02T11:29Z.

    [10] The completion was announced on Tildeverse IRC's #team channel
    on 2021-08-02T11:33Z.
    --- Synchronet 3.19a-Linux NewsLink 1.113
  • From James Tomasino@tomasino@cosmic.voyage to tilde.team on Thu Aug 12 11:08:40 2021
    On 2021-08-10, xwindows <xwindows@tilde.club> wrote:
    P.S. For the record, current Tildeverse Netnews NNTP topology
    is as follows:

    news.tilde.club/
    news.tildeverse.org <-------. ,-------> yourtilde.com
    (public gateway) | | (public gateway)
    ^ v v
    | cosmic.voyage
    | *A (distribution point)
    | ^ ^
    | | |
    tilde.team <--------------' '-------> baud.baby

    Thanks so much for your hard work on this xwindows. You clearly have the
    most knowledge and experience in net news on the tildeverse and it's a
    really boon to us all trying to get this running and adopted.

    About the topology above: cosmic is pre-configured and ready to push and receive content from the following servers if they set up their side:

    - tilde.pink (used to work)
    - breadpunk.club (acdw has this on the radar to integrate)
    - tilde.institute

    If any other tilde admins want to peer with the rest of us, please reach
    out. As much as I enjoy cosmic being a central distribution point it
    would be nice to have at least 2 ways in/out from each node in case of
    problems like we ran into with team.
    --- Synchronet 3.19a-Linux NewsLink 1.113
  • From xwindows@xwindows@tilde.club to tilde.team on Sat Aug 14 12:07:38 2021
    On Thu, 12 Aug 2021, James Tomasino wrote:

    About the topology above: cosmic is pre-configured and ready to push and receive content from the following servers if they set up their side:

    - tilde.pink (used to work)
    - breadpunk.club (acdw has this on the radar to integrate)
    - tilde.institute

    If any other tilde admins want to peer with the rest of us,
    please reach out.

    Another Tilde server which I know for sure that it has a running
    Netnews server is RadioFreq.space (OpenBSD), and its homepage
    explicitly listed Tildeverse Netnews service [1]; but I'm not sure
    about its current newsgroups set and peering status as it doesn't seem
    to accept newsreading requests from the outside...

    $ nc radiofreqs.space 119
    502 You have no permission to talk. Goodbye!

    According to few posts I have found in our current news spool (from Tilde.club's perspective): this server is, or at least used to be
    a peer in Tildeverse Netnews, at least from late 2019 to early 2020.

    `Path:` header inspection on articles which originated from [2]
    or routed through there revealed unusual thing about this server:
    messages in question always seems to have following segment
    in their propagation path:

    ... <- cosmic.voyage <- baud.baby <- radiofreqs.space

    And there is another message [3] with following path:

    ... <- cosmic.voyage <- baud.baby <- radiofreqs.space <- yourtilde.com

    So, back in that era, this server might hadn't been peered directly
    with Cosmic.voyage; but rather through Baud.baby, and probably also
    through YourTilde.com. Based on what you have said about existing
    peering configuration on Cosmic.voyage (or lack of thereof)
    and very limited and vague information I currently have
    based on posts by several people, I _guesstimated_ that
    circa-2019 Ye Olde Netnews might had a topology that looked like this:

    news.tilde.club <-----> cosmic.voyage <-----> baud.baby
    ^ ^ ^
    | | |
    | | v
    tilde.team <---------' | radiofreqs.space
    | ^
    v |
    yourtilde.com <-------'

    I have tried asking ~cat about the old link between Baud.baby
    and RadioFreqs.space in IRC before [4], but I didn't get any reply;
    so I have no idea how accurate this historical picture was.

    Anyway, it might be a bit difficult to make this one work though,
    unless someone managed to contact the admin there (~nonlinear).

    Regards,
    ~xwindows


    [1] <https://radiofreqs.space/>
    ^ Contains expired TLS certificate despite the site insisting
    on HTTPS; a sign of neglect, I presume.

    [2] All messages I found originating from RadioFreqs.space (oldest first)
    are as follows:

    - [2019-09-23T05:18:31Z] "Hi YourTilde", posted by ~nonlinear
    <news:slrnqogld7.1auj.nonlinear@radiofreqs.space>
    <nntp://news.tilde.club/tilde.meta/42>

    - [2019-11-18T03:07:36Z] "Re: Do you Usenet?", posted by ~nonlinear
    <news:slrnqt42no.1poq.nonlinear@radiofreqs.space>
    <nntp://news.tilde.club/tilde.meta/45>

    - [2020-01-10T22:18:02Z] "Re: A desktop", posted by ~nonlinear
    <news:slrnr1hu0q.20d7.nonlinear@radiofreqs.space>
    <nntp://news.tilde.club/tilde.art.ascii/9>

    [3] All message I found being routed through RadioFreqs.space
    is the following:

    - [2019-09-23T05:34:30Z] "Re: Hi YourTilde", posted by ~deepend
    <news:alpine.LFD.2.21.1909222234250.10748@yourtilde.com>
    <nntp://news.tilde.club/tilde.meta/43>

    [4] In Tilde.chat's #netnews channel, on 2020-12-04T07:06Z.
    --- Synchronet 3.19a-Linux NewsLink 1.113