Downloading all headers

[crmartin]

I am having problems when subscribing to new newsgroups in that only the last 30 days are being downloaded. I am subscribed to two news servers and I know that the retenting is much higher than that. These are text newsgroups.

[alex]

did you check settings in properties->newsgroups, retention and last headers?

if settings are ok try also to download headers from news.microsoft.com are older headers downloaded?

[crmartin]

Headers per server is set for ALL Rest is set for retain.
Retention is set for 60D
I don't see "last headers".
I added news.microsoft.com, reset headers and rescaned and still only get 30-37 days

News group list shows:
microsoft.public.windows.vista.installation_setup
12,120 headers - downloaded headers - 2351

microsoft.public.windows.vista.general
348,774 headers - downloaded headers - 19,185

[alex]

forgot about this thread.

last headers i meant "headers per server", so it is "all"

is computer clock set right? if you set retention to "natural" (temporarily) do you get all headers?

i see microsoft has about 90 days of retention in the vista group

[crmartin]

My clock is correct.

I tried setting headers per server to all.
Retention set to natural.
Still have the same problem.

I do not have this probles at home using the same servers. I even copied my UE folder and brought that into work and still cannot download all headers. I can download the bodies from the headers in the copy I brought from home. Some of them are more than a year old.

Servers I use are:
unlimited.newshosting.com
new.alltelnet and news.atlanticbb.com
and tried news.microsoft.com

[alex]

better you check it all with news.microsoft.com since i can see the server retention here.

maybe you have created and added an initial filter which limits the date range of displayed headers?

also check your properties->newsgroups, the topmost "default" entry, you should see "Initial filter" - None, "Retention/dates" - Natural (but you need to change it later to some limited retention), "Headers per server" - All.

also in workspace, leftmost pane, newsgroups->context menu->advanced invoke "reset header ranges" before downloading headers in case you had before a lower retention and you answered "no" when it asked whether to redownload headers again when you increased the retention.

if all above doesn't work, but check it carefully, i don't think i missed something, invoke properties->general->database folder, change, then point it to a new location, in properties->newsgroups set retention to natural and headers to all, add news.microsoft.com and download headers from microsoft.public.windows.vista.general what retention do you see?

[crmartin]

I have set all the settings per your instructions. Still only 30 days.

I set up a new database as per instructions using only news.microsofts.com and microsoft.public.windows.vista.general as the only newsgroup. Still only 30 days.

I also now just noticed I can't do searches unless I purchase a new license.

[alex]

i've just created a new instance with database folder->change, then restart, it asks whether to create database.

then i entered the news.microsoft.com server and the microsoft.public.windows.vista.general newsgroup

i don't change any settings.

then i just invoke "get new headers", then i press F6 (to toggle show dates/age, by default it shows dates for a new install).

the i click the "age" column to sort by age.

i see 90 days.

it cannot be anything different. can you try again the exact sequence?

can you give me a similar screenshot like this one:

http://www.netwu.com/ue/uemicvis90.gif

if i would exit and restart the program or unload (not just close) and reopen the newsgroup we would see 60 day retention since currently it is default for new installs in properties->newsgroups but if you increase it you can keep any retention you want.

[crmartin]

New install and new databases. No changes made to settings.

Newserver: news.microsoft.com
group: microsoft.public.windows.vista.general

Here are two screen shots:

http://picasaweb.google.com/crmartin1/UE

Still only 30 days.

[alex]

as to news.microsoft.com we need to verify first you go to the same physical server.

try to create a new database instance, after entering news.microsoft.com go to properties->proxy, check "access proxies", then click "news.microsoft.com" and check "access proxy" below.

then enter the proxy (i've sent pm to you with host/port), you can only check it from the ip you are using for your forum posts.

i reverified on the computer through which you will access the microsoft server the retention is 90 days as elsewhere.

if you still see 30 days - just rar the database and email it to me, i'll check it from here.

your computer clock is ok, i see the same retention for those headers on the first screenshot.

[alex]

on the second thought - just email me the database anyway, i'll check it, before emailing it recheck that if you reset headers and download headers again - the retention is still 30 days.

ue doesn't use registry so everything is in the database, the reason only might be in the server or in the settings which are in the ue database directory.

[crmartin]

I added the proxy and all headers are downloading (60 days). I then reset retention to 90 and reset and rescanned and got 90 days.

I then reverted back to the original database without the proxy, reset and rescanned and received only 30 days.

I am emailing you the original databases (30 days).

Thanks for all your help.

I have purchased a new license for UE as I have tried them all and UE is without a doubt the best (including support)!

[alex]

if you try to use the proxy with your other server the retention is also ok?
(but use it only very shortly for the test).

if it is only microsoft it can be explained they have several physical servers and your ip range happens to access a server of theirs with lower retention.

[crmartin]

No, it doesn't work with my other servers.

I disabled it after testing.

[alex]

with the microsoft server, download some article body and check the article source (there is option "view source" in the article view), check that the xref: header indicates the article has indeed came from the microsoft server, just an impossible scenario if something redirects you somewhere else.

otherwise it seems we've reduced the problem to this thread:

http://www.netwu.com/newspro/phpBB2/vie ... php?t=2411

i had even changed the subject line so it won't be the same with this thread, but now it appears it is the same cause then.

it looks like there is a kind of server around or a kind of server configuration which keeps more retention in bodies than headers probably relying on downloads through nzb files.

with the microsoft server, since through the proxy (so you access the microsoft server through the computer where i accessed it as well) we have the same picture, it is just a coincidence your ip goes to a physical server with less retention.

the two servers (those which are not newshosting) i cannot find or even resolve probably you mistyped their names (but anyway i don't have access to them). did you try to check with their support why their header retention is less than the bodies retention?

i don't have access to unlimited.newshosting.com, but i checked with news.newshosting.com, for the vista general group i see 39 day retention, it might be the same case with unlimited, you can check with their support as well.

with NGroups and UNS it appears headers and bodies retention is the same, like 117 days both.