Page 1 of 1

Minimizing amount of overview (header) data.

Posted: Mon Mar 01, 2004 7:07 pm
by *MoonDogg*
I have a Supernews.com account. I have a problem that I did not experience with my Newscene account, in that the amount of overview/header data being downloaded is almost as much as the actual article data, and I am hitting my limits very quickly.

Perhaps Newscene did not count overview data towards my monthly limit, surely I never saw any statistics for it in my usage report.

Bottom line is that I have a 10 GB monthly limit, and when I look at my usage it shows:

Article data - 7.25 GB
Overview data - 4.12 G

That seems really unusual to me that I would be downloading so much overview data, compared to how much article data.

I don't have the scheduler enabled, so its not like its runing constantly. I mostly use that mp3/warez groups.

Any tips on minimizing this? Or is there really no way around it?

thanks

*MoonDogg*

Posted: Tue Mar 02, 2004 3:45 am
by alex
header data is a lot, xover doesn't have any optimization so, e.g. if you see a partial message entry with 50 parts 200 byte subject+author+other xover data - it costs you 50*200=10K to download this header.

you can define retention or last headers in properties->newsgroups to reduce the amount of downloaded header data; don't reset newsgroups so headers won't be downloaded again.

if you have a good provider which doesn't count header data - you can use it to download headers and the other service - only for downloading bodies through message-id direct.

Posted: Tue Mar 02, 2004 9:34 am
by jaapf
Or use xpat (if your server supports it) instead of getting all headers.

You could browse groups on newzbin.com (or some other index-service wich allows free browsing) and using headertitels/filenames you find there in your Xpat-box.

You also could download an NZB using Evolution-search or NPhelper to get the message-ID's to download.