Search inside archives feature. Is it possible?

03 Oct 23: One server has been relocated, the server currently doesn't have a public IP address in the meantime. I wrote some additional tunnel code running separately to handle this. When the server is engaged the connection is 5600+ days uniform (since around 24 July 2008). In the unlikely case I disengaged the server because of some problem the retention is 1200-3800 days depending on newsgroup. If you experience any issue please let me know.

29 Nov 23: Because of encrypted and "obfuscated" flood mass posted by few nzb websites and newzbin-like communities using usenet servers as private storage for their members to download the posts - the situation with the content is pretty chaotic, since posts are disguised in such a way, that users must use the satellite ecosystem (whish is not a part of Usenet) exclusively to download them, when the website disappears - the encrypted scattered posts just eat usenet providers' disk space uselessly. If you can't find something specific please let me know what exactly you can't find for me to check how it is possible to retain the posts. Legible posts shouldn't be affected at all, let me know if you notice anything missing.

08 Aug 24: After being unchanged for many years the search service communication protocol had to be updated a few times in part to resolve a server side set feature limitation and properly handle trial searches on the relocated server. The searches themselves are not affected and it looks like the work is now complete.
Post Reply
semel666
Posts: 46
Joined: Fri Jan 08, 2010 10:11 am

Search inside archives feature. Is it possible?

Post by semel666 »

Ive recently discovered the new search engine out there - http://www.mysterbin.com
And what really amazed me was that MB could search within archives

For instance:

http://www.mysterbin.com/search?q=blue+ ... e=0&group=

archive name "ich844" You cant guess what is inside.
But MB reveals you the secret - ****.mkv.

I understand that web based search and built-in search is totally different, i guess.
But still i cant help but wonder if it is possible somehow to implement this feature?
alex
Posts: 4545
Joined: Thu Feb 27, 2003 5:57 pm

Re: Search inside archives feature. Is it possible?

Post by alex »

The rar file format doesn't have a file directory, the file information is scattered through the rar file.

So if many small files the only way is to download everything, if not maybe one can seek for parts containing rar headers with file names.

Web services use sql databases with limited search language (I don't know about this site), so it is maybe more flexible as hardware becomes faster, with UE search service there are hardcoded data structures with the capability to search for everything posted whether subjects are formatted well or not, but I may need to look for changes because of rising retention.
semel666
Posts: 46
Joined: Fri Jan 08, 2010 10:11 am

Re: Search inside archives feature. Is it possible?

Post by semel666 »

I see ,thanx for explanation about this one
Post Reply