Header download seems very slow 1M/hour

Post Reply
tieftrunk
Posts: 8
Joined: Sun Jan 09, 2005 5:32 pm

Header download seems very slow 1M/hour

Post by tieftrunk »

Is there any setting to speed up header downloads? Like download more at once? I'm getting 100KB/s on my 8gbit connection.

Thanks!
alex
Posts: 4543
Joined: Thu Feb 27, 2003 5:57 pm

Post by alex »

downloading headers is not a bottleneck in UE.

check what is processor usage of the UE process, but it should be low.

if it is consistently below 100% it is what your server gives (the more newsgroup views you open the more will be the processor load since it needs to update views dynamically, but usually it is not an issue since the algorithm is quite good).

ensure nothing sits in the middle like antivirus or firewall which causes the slowness.

if the issue is temporary it might be newsserver problem (try to to download headers from e.g. news.microsoft.com with many tasks). also you may try to use different ports if your newsserver gives you such an option, also try to run many header tasks at once to see whether the speed will improve.

as to bandwidth settings properties->tasks, but i guess you didn't set a limit there and didn't press the pause button.
tieftrunk
Posts: 8
Joined: Sun Jan 09, 2005 5:32 pm

Post by tieftrunk »

Interesting, I noticed that only two tasks were created, even though the max header tasks is set at 20. When I started a download, 6 more tasks were created for the download (max server connections is 8 ).
alex
Posts: 4543
Joined: Thu Feb 27, 2003 5:57 pm

Post by alex »

check whether properties->tasks, max groups is set to some number, it may reduce the number of header tasks so no more than max.groups will be getting headers in the same time keeping rest of newsgroups in the header task list unloaded thus reducing RAM consumption (you can set max.groups value empty so it won't be used at all or set it to some large number, if you use compact binary newsgroup type since then RAM consumption is less critical - the amount of database memory is shown in the status line). there some considerations in help notes (UE.txt).

the said above is not related to header download speed though :)

but i guess you are talking about process thread count, on program start with no tasks it is 2 threads, for actual tasks look in the usenet explorer task manager in the running header task pane (the computer icon pane to the right of the "headers" book with dot pane), it should be predictable given settings and other server tasks currently running (in other running task panes, if something there computer icons turn green otherwise they are gray).
tieftrunk
Posts: 8
Joined: Sun Jan 09, 2005 5:32 pm

Post by tieftrunk »

It's strange, it seems that the header tasks are limitted to 2, even though there are no other server tasks running. I disabled max.groups.
alex
Posts: 4543
Joined: Thu Feb 27, 2003 5:57 pm

Post by alex »

maybe you download headers only for 2 newsgroups? there is only 1 header task per server per newsgroup, so if you download headers e.g. for 5 newsgroups from 2 servers there can be at most 5*2=10 tasks. the consideration (as far as i know it is the same in all newsreaders) applies only for header tasks, with article tasks there is no such issue.
tieftrunk
Posts: 8
Joined: Sun Jan 09, 2005 5:32 pm

Post by tieftrunk »

Thanks, that was it.. two newsgroups. Could have sworn it was faster before, there must be server issues.
jonib
Posts: 397
Joined: Thu Feb 27, 2003 8:46 pm
Location: Sweden

Post by jonib »

alex wrote:maybe you download headers only for 2 newsgroups? there is only 1 header task per server per newsgroup, so if you download headers e.g. for 5 newsgroups from 2 servers there can be at most 5*2=10 tasks. the consideration (as far as i know it is the same in all newsreaders) applies only for header tasks, with article tasks there is no such issue.
I know at least one newsreader that can use more then one header task per newsgroup per server called BNR2 (Binary News Reader) http://www.bnr2.org/

I have been thinking to request support for this, sometimes I want to get headers for one big newsgroup and it would be great to use full bandwith.
tieftrunk
Posts: 8
Joined: Sun Jan 09, 2005 5:32 pm

Post by tieftrunk »

Just a followup - I am now getting much faster article downloads, so I think the usenet server I use must have been unusually slow before.
Post Reply