Search inside archives feature. Is it possible?

03 Oct 23: One server was relocated, the server currently doesn't have a public IP address since in the meantime it is running on starlink. I wrote some additional tunnel code running separately to handle this. When the server is engaged the connection is 5600+ days uniform (since around 24 July 2008). In the unlikely case I disengaged the server because of some problem the retention is 1200-3800 days depending on newsgroup. If you experience any issue please let me know.

29 Nov 23: Because of encrypted and obfuscated posts flood mass posted by a few nzb indexing websites using usenet servers as private storage for their members to download the posts - the situation with the content is pretty chaotic since their purpose is to post in such a way, so users must use their website exclusively, when the website disappears - the encrypted posts just eat usenet providers' hard disk space uselessly. If you can't find something specific please let me know at alexbirj at gmail dot com what exactly you can't find for me to check how it is possible to retain the posts. Non-obfuscated posts shouldn't be affected at all, let me know if you notice anything missing.

29 Nov 23: The search protocol had to be upgraded to extend 3 byte (16M+) limit on the server side for number of sets per instance, so at least the version 5.8.3 is needed to access it, otherwise should be no any difference.
Post Reply
semel666
Posts: 46
Joined: Fri Jan 08, 2010 10:11 am

Search inside archives feature. Is it possible?

Post by semel666 »

Ive recently discovered the new search engine out there - http://www.mysterbin.com
And what really amazed me was that MB could search within archives

For instance:

http://www.mysterbin.com/search?q=blue+ ... e=0&group=

archive name "ich844" You cant guess what is inside.
But MB reveals you the secret - ****.mkv.

I understand that web based search and built-in search is totally different, i guess.
But still i cant help but wonder if it is possible somehow to implement this feature?
alex
Posts: 4514
Joined: Thu Feb 27, 2003 5:57 pm

Re: Search inside archives feature. Is it possible?

Post by alex »

The rar file format doesn't have a file directory, the file information is scattered through the rar file.

So if many small files the only way is to download everything, if not maybe one can seek for parts containing rar headers with file names.

Web services use sql databases with limited search language (I don't know about this site), so it is maybe more flexible as hardware becomes faster, with UE search service there are hardcoded data structures with the capability to search for everything posted whether subjects are formatted well or not, but I may need to look for changes because of rising retention.
semel666
Posts: 46
Joined: Fri Jan 08, 2010 10:11 am

Re: Search inside archives feature. Is it possible?

Post by semel666 »

I see ,thanx for explanation about this one
Post Reply