protocol for searching headers

03 Oct 23: One server has been relocated, the server currently doesn't have a public IP address in the meantime. I wrote some additional tunnel code running separately to handle this. When the server is engaged the connection is 5600+ days uniform (since around 24 July 2008). In the unlikely case I disengaged the server because of some problem the retention is 1200-3800 days depending on newsgroup. If you experience any issue please let me know.

29 Nov 23: Because of encrypted and "obfuscated" flood mass posted by few nzb websites and newzbin-like communities using usenet servers as private storage for their members to download the posts - the situation with the content is pretty chaotic, since posts are disguised in such a way, that users must use the satellite ecosystem (whish is not a part of Usenet) exclusively to download them, when the website disappears - the encrypted scattered posts just eat usenet providers' disk space uselessly. If you can't find something specific please let me know what exactly you can't find for me to check how it is possible to retain the posts. Legible posts shouldn't be affected at all, let me know if you notice anything missing.

08 Aug 24: After being unchanged for many years the search service communication protocol had to be updated a few times in part to resolve a server side set feature limitation and properly handle trial searches on the relocated server. The searches themselves are not affected and it looks like the work is now complete.

15 Mar 25: It looks like the search service is currently down as there are no pings. The other server is no more on starlink, but the search requests are still routed and the access to it is through the first server, since it is safer, but the direct access is no problem if this will be a repeated issue. The connection will be restored or server restarted as soon as possible.

16 Mar 25: One server is currently still down, the other server was reconfigured and already connected directly, so the search service is running with minimum possible retention gaps.
Post Reply
Leechmonkey
Posts: 59
Joined: Sat Nov 05, 2005 1:28 pm

protocol for searching headers

Post by Leechmonkey »

Besides XPAT, is there anyone working on a common protocol so that different readers can access, say, UE's search index (with pay of course). I know there isn't one that exists today but seeing that you have contributed to newzbin before, maybe there is one in the talks? just curious.
Top
alex
Posts: 4547
Joined: Thu Feb 27, 2003 5:57 pm

Post by alex »

no, it seems everyone implements its own protocol.
it also depends on the underlying server software and available hardware.

if to create a standard protocol i think it would be better to base it on boolean wildmats (wildmats are already used in XPAT) since other existing search services can be easily reduced to them, and regex would be too heavy on processor.

i talked about such a protocol with newzbin but it didn't go further so far maybe because i'm busy with other things (they have the idea though) and they are not especially supportive of this particular client - it seems their users prefer simple nzb downloaders skipping the header stage alltogether as everything goes down the road towards extreme simplicity of a binary repository.
Top
Post Reply

Return to “Search service”