I tried as every day to get new headers for my groups. As it reaches the big multimedia groups memory usage grows like mad (400 megs and going up). I resetted all groups and restarted the header download. This takes the whole day. Again, it hangs like crazy, memory usage, program freezes.
ARGH. What to do?
UE no longer working
UE doesn't use registry except for setting tne nzb file association, default newsreader (both are not UE specific) and keeping the database path.
database is also self-repairing, it is comprehensively verified on start and the starting code (given hard drive and windows file structure are ok) is bullet-proof, so if there is any problem on start - to fix it should be enough to check the hard drive for errors, since file errors like corrupted file structure or bad sectors (the latter would mean the hard drive should be replaced as well) cannot always be possibly dealt with.
and yes when using other than compact binary newsgroup type, the RAM usage may be significant, about 12M of headers will take about 1GB of RAM causing all kinds of delays on loading a big newsgroup and windows RAM limit in 32 bit system without /3GB switch is about 1.4GB and with the switch 2.4GB, in short for large newsgroups one needs to use the compact binary type, then even if newsgroup contains 150M headers it still can be dealt with not so much RAM.
database is also self-repairing, it is comprehensively verified on start and the starting code (given hard drive and windows file structure are ok) is bullet-proof, so if there is any problem on start - to fix it should be enough to check the hard drive for errors, since file errors like corrupted file structure or bad sectors (the latter would mean the hard drive should be replaced as well) cannot always be possibly dealt with.
and yes when using other than compact binary newsgroup type, the RAM usage may be significant, about 12M of headers will take about 1GB of RAM causing all kinds of delays on loading a big newsgroup and windows RAM limit in 32 bit system without /3GB switch is about 1.4GB and with the switch 2.4GB, in short for large newsgroups one needs to use the compact binary type, then even if newsgroup contains 150M headers it still can be dealt with not so much RAM.
I'm not sure if i have the same problem but i sure i joined at least two groups that has a lot of headers, my miachine has 2gb of ram and i don't see any trouble of slowdowns or other, it's also stable with the various programs and the system didn't had any change , however on the past mounth it happen very often that Ue abort and i don't know what's happening other than an 'internal error' on the log; the problem appen now too often, i can say two time every 3 days leaving Ue always on so i think it's now the time to solve it.
reading this thread i can confirm that same groups increased the headers number so i think now i'm going on the right way, just i'm asking what's i need to look for in order to tweak the settings and getting Ue running stable without changing too many values and cause other problems.
Foe example the compact binary option is disabled and i can't find a way to enable it, i suppose i'm searching uncorrectly?
At the moment i'l try to suspend same groups to be sure if they're responsible of the problem.
Another thing, sametimes i noticed some diagnostic trobles on same groups with big traffic (they're anime related), with undeletable headers and other issues that i can solve by restarting Ue and deleting the headers in one or more tries; however they're not the groups with the biggest header numbers, just the ones where i download more than the others....
downloads decreased a little in the last time so i think it's not related..
i was missing the important part; when i subscribed the actual server the retention was approx 13 day , it incremented and when i experimented the first crash was approx 40 days, now the crashes keeped increasing and i noticed the retention goin up to 50 and 60 days; in the last 3 days i had 3 crash and in this moment i'm checking for a retention of 85-90 day???
It seem to be well connected.
reading this thread i can confirm that same groups increased the headers number so i think now i'm going on the right way, just i'm asking what's i need to look for in order to tweak the settings and getting Ue running stable without changing too many values and cause other problems.
Foe example the compact binary option is disabled and i can't find a way to enable it, i suppose i'm searching uncorrectly?
At the moment i'l try to suspend same groups to be sure if they're responsible of the problem.
Another thing, sametimes i noticed some diagnostic trobles on same groups with big traffic (they're anime related), with undeletable headers and other issues that i can solve by restarting Ue and deleting the headers in one or more tries; however they're not the groups with the biggest header numbers, just the ones where i download more than the others....
downloads decreased a little in the last time so i think it's not related..
i was missing the important part; when i subscribed the actual server the retention was approx 13 day , it incremented and when i experimented the first crash was approx 40 days, now the crashes keeped increasing and i noticed the retention goin up to 50 and 60 days; in the last 3 days i had 3 crash and in this moment i'm checking for a retention of 85-90 day???
It seem to be well connected.
fk0, two things you can do:
As jonib says, resubscribe to the large groups that contain many headers but make sure that you select 'compact binary' in the box that pops up. If you resubscribe to many groups all at once then you only need to select 'compact binary' once, then UE will remember the setting and you will only need to click 'OK' to the rest. You can check to see what your current group types are by right-clicking on the group's name in the workspace and choosing Advanced->Rename or by reading through 'map.txt' in your '\Database\Newsgroups' directory.
Secondly, you should go to Properties->Newsgroups and set your retention to a static range that matches or is less than your server. With compact binary group types this is less crucial. With other group types you really need to make sure that you aren't retaining headers indefinitely. In 'Retention/Dates [range]', put in your retention as you see fit after experimenting. For a set number of days, simply put nd, e.g. for a server with 50 day's retention, use '50d'. Using compact binary combined with a reasonably fast computer, you should not see a slowdown - even with millions of headers and huge or no retention set, at least for a while.
As jonib says, resubscribe to the large groups that contain many headers but make sure that you select 'compact binary' in the box that pops up. If you resubscribe to many groups all at once then you only need to select 'compact binary' once, then UE will remember the setting and you will only need to click 'OK' to the rest. You can check to see what your current group types are by right-clicking on the group's name in the workspace and choosing Advanced->Rename or by reading through 'map.txt' in your '\Database\Newsgroups' directory.
Secondly, you should go to Properties->Newsgroups and set your retention to a static range that matches or is less than your server. With compact binary group types this is less crucial. With other group types you really need to make sure that you aren't retaining headers indefinitely. In 'Retention/Dates [range]', put in your retention as you see fit after experimenting. For a set number of days, simply put nd, e.g. for a server with 50 day's retention, use '50d'. Using compact binary combined with a reasonably fast computer, you should not see a slowdown - even with millions of headers and huge or no retention set, at least for a while.
I found that the option compact binary is already active on all groups i have, probably 10 groups and 3 with big traffic, the retention is already set to 14d so at least on this part i'm already ok. the machine is a 2.6 p4 and 2gb ram with tipycal 30% usage;
more than one time UE sayed me to check my memory, i did same check, but i can tell that: i reboot the system every 2week to 1 mounth to be sure that remain stable, i have tasks running for 1 week straight without problems and i rarred a lot of data (that's because i want the recovery record) and i never had a corrupted archive on this machine; also the machine is in a DMZ, i never installal software and recently updated only java and same manually selected windows updates (yes, i'm very strict about this machine stabilty).
Instead while using it i tweaked UE settings many times and i suppose that here is the trouble, just i don't know exactly. So now i'll try this:
-install UE on another machine and compare with the default settings
-create a new database from scrach manually copying the settings
-recover the entire system from a backup and apply the necessary update/changes and see what happen.
i think it'll take so long so don't expect i report a successful solution unless i found samething immediately, thanks for yor help guys.
EDIT: found that i was tracking all deleted/dowloaded/purged/etc headers for 30 days, now i disabled it and ill see what happen.
more than one time UE sayed me to check my memory, i did same check, but i can tell that: i reboot the system every 2week to 1 mounth to be sure that remain stable, i have tasks running for 1 week straight without problems and i rarred a lot of data (that's because i want the recovery record) and i never had a corrupted archive on this machine; also the machine is in a DMZ, i never installal software and recently updated only java and same manually selected windows updates (yes, i'm very strict about this machine stabilty).
Instead while using it i tweaked UE settings many times and i suppose that here is the trouble, just i don't know exactly. So now i'll try this:
-install UE on another machine and compare with the default settings
-create a new database from scrach manually copying the settings
-recover the entire system from a backup and apply the necessary update/changes and see what happen.
i think it'll take so long so don't expect i report a successful solution unless i found samething immediately, thanks for yor help guys.
EDIT: found that i was tracking all deleted/dowloaded/purged/etc headers for 30 days, now i disabled it and ill see what happen.
it is very simple, if you see something in the error log just email it to me log.txt then we continue discussion here what went wrong with your computer. frequent crashes are not normal, you need some "luck" to get even a single crash a year.
if crashes are very frequently it should be some apparent problem, if it is faulty memory i can tell it since crashes appear to be random when a place gets hit proportionally to how frequently it the function which is operates on random locations in the database is called.
if it is some driver usually i can also tell it, sometimes you see the driver name in log.txt usually when it calls to ntdll.dll, i have some good crash statistics management in place.
the program was reliable from the beginning (since i only released it after about half a year of testing with group of users) comparing to other programs when i was able to crash them within minutes just randomly pressing buttons, the reliability increased little by little until a year ago (May, 2006), since then it remained virtually unchanged.
reinstalling etc. doesn't make much sense since UE verifies the database every time it starts and every time a newsgroup is loaded it is checked for integrity.
in short email me your log.txt then i may well tell it what it is. i think it is also mentioned in the error message box. let me know when it has been emailed, i check emails then (they are not on the work computer).
if crashes are very frequently it should be some apparent problem, if it is faulty memory i can tell it since crashes appear to be random when a place gets hit proportionally to how frequently it the function which is operates on random locations in the database is called.
if it is some driver usually i can also tell it, sometimes you see the driver name in log.txt usually when it calls to ntdll.dll, i have some good crash statistics management in place.
the program was reliable from the beginning (since i only released it after about half a year of testing with group of users) comparing to other programs when i was able to crash them within minutes just randomly pressing buttons, the reliability increased little by little until a year ago (May, 2006), since then it remained virtually unchanged.
reinstalling etc. doesn't make much sense since UE verifies the database every time it starts and every time a newsgroup is loaded it is checked for integrity.
in short email me your log.txt then i may well tell it what it is. i think it is also mentioned in the error message box. let me know when it has been emailed, i check emails then (they are not on the work computer).
I'm not sure if is this but i found same big problems around a non pnp driver related to avg antivirus, later i found that avg updater for two month failed to install updates many times and it seem that there was mismatch version of his libraries (compared to another machine), in fact later i got data corruption on a dvd because i forced a failed update of avg while burning it; so i removed avg and installed it again and repeated the same exact steps, this time everything went fine and UE is working fine from two day, before i got 4 abort in a day with error c0000005 on ue log; now i increased retention and everything else on UE to force a heavy load on it and see what happen.
Digging on the various logs i found that avg started his problems in early may when i manually installed a bunch of windows updates then the errors from the updater increased the frequency until now....
i'll provie info later if i find samething else.
Digging on the various logs i found that avg started his problems in early may when i manually installed a bunch of windows updates then the errors from the updater increased the frequency until now....
i'll provie info later if i find samething else.
with such crashes you usually see a high address here is an example:
UE1950R internal error (77FCD989/C0000005)
....
77FCB80C 076FEF7C 0003:0000180C C:\WINNT\system32\ntdll.dll
67BDF946 076FEFC4 0001:0000E946 d:\Norman\nvc\bin\Niphk.dll
sometimes you see the driver which caused the crash, but sometimes you see only ntdll.dll, since the driver bug is usually to corrupt the memory allocation heap it is not able to unwind the stack afterwards. it is when it happen in the user mode so in the process address space thus crashing the driver host process, if it happens in the system mode (when the driver is executed below the winsock after a kernel call has been made) the driver bug may result in the blue screen, it was the case with some previous versions of kaspersky at least in vista. ue doesn't have drivers so it must be a third party driver to create such issues.
UE1950R internal error (77FCD989/C0000005)
....
77FCB80C 076FEF7C 0003:0000180C C:\WINNT\system32\ntdll.dll
67BDF946 076FEFC4 0001:0000E946 d:\Norman\nvc\bin\Niphk.dll
sometimes you see the driver which caused the crash, but sometimes you see only ntdll.dll, since the driver bug is usually to corrupt the memory allocation heap it is not able to unwind the stack afterwards. it is when it happen in the user mode so in the process address space thus crashing the driver host process, if it happens in the system mode (when the driver is executed below the winsock after a kernel call has been made) the driver bug may result in the blue screen, it was the case with some previous versions of kaspersky at least in vista. ue doesn't have drivers so it must be a third party driver to create such issues.