Flushing the database

Post Reply
Guest

Flushing the database

Post by Guest »

Hi,

First I really must commend on a good job by Alex on this beautiful piece of art.

A couple of questions -

1. Is there a way to flush the database besides quiting? The first time try this out I spend a couple of hours trying to sync up several binaries group and I was happily downloading. It just so happens that my PC rebooted along the way. To my dismay, I lost everything. Needless to say, I wasted another few hours sync-ing up again.

2. What would be the meaning of a 'natural' type of header retention?

3. I'll need to confirm that if you delete and subsequently purge the headers, it'll be stored in the history to prevent the same header from comming back?

4. Is it possible to change the action when you click on the green box at the left of each thread to indicate 'Download&Save attachment' instead of just download? If there's no attachment, then it'll default to just download?

5. Is it possible to put in an option where the save directories takes on the name of the newsgroup the article comes from by default?

6. Is there an easier way to check the activities of each NNTP servers that we have? ie, news.abc.com is currently having 3 tasks, task 1 is downloading article number xxx, task 2 is downloading headers from alt.blahblahblah etc. I know you can iterate through the task window to find out .....

7. Does it have a problem with SETI@Home? Seems like my SETI crashes intermittenly after using this.

That's all for now, thanks.

Regards,
JK
alex
Posts: 4549
Joined: Thu Feb 27, 2003 5:57 pm

Re: Flushing the database

Post by alex »

1. Is there a way to flush the database besides quiting? The first time try this out I spend a couple of hours trying to sync up several binaries group and I was happily downloading. It just so happens that my PC rebooted along the way. To my dismay, I lost everything. Needless to say, I wasted another few hours sync-ing up again.

you can enable properties->general, database backup and then invoke file menu->save database&restart when you need to save the current state (otherwise it will be the state on the beginning of the session, but better to have a normally functioning computer.

2. What would be the meaning of a 'natural' type of header retention?

when headers expire on servers

3. I'll need to confirm that if you delete and subsequently purge the headers, it'll be stored in the history to prevent the same header from comming back?

yes, it is stored, just such headers cannot be undeleted without disabling purging with consequent rescan.

4. Is it possible to change the action when you click on the green box at the left of each thread to indicate 'Download&Save attachment' instead of just download? If there's no attachment, then it'll default to just download?

yes just invoke download&save, also if you invoke with different priority it will be reflected, you don't need to unmark first since it may result in small waste of bandwidth if running tasks are cancelled.

5. Is it possible to put in an option where the save directories takes on the name of the newsgroup the article comes from by default?

you can set arbitrary directories in properties->general - on per newsgroup basis, if you like you can use newsgroup names, it seems the most useful to set separate directories when you invoke download&save (directory per batch).

6. Is there an easier way to check the activities of each NNTP servers that we have? ie, news.abc.com is currently having 3 tasks, task 1 is downloading article number xxx, task 2 is downloading headers from alt.blahblahblah etc. I know you can iterate through the task window to find out .....

task manager, if you expand combo you'll see tasks with servers.

7. Does it have a problem with SETI@Home? Seems like my SETI crashes intermittenly after using this.

there is another thread below, it looks like you have some hardware/software problem (normally computer doesn't reboot by itself).
Guest

Post by Guest »

Hi Alex,

I'd agree my copy of NSW is acting up. Not sure why. 2 times it rebooted the damn machine while Newspro is busy downloading. And 2 times after that, Newspro will start with no data! Except for those which got downloaded.

Regarding the flushing of db, I guess the only way to save the state is to manually intervene? Let's say I do a save db & restart, does it save a copy of the db somewhere else as in really a backup? Or do I have to manually copy the db directory myself in order to have a backup copy?

For headers expiration, are you saying then that Newspro actually check if the old headers had expired? Wouldn't this be very slow, especially on large binaries groups? Or did you just go by article number and expires those with article number less that what is reported by the NNTP servers?

Thanks for your time.

Regards,
JK
alex
Posts: 4549
Joined: Thu Feb 27, 2003 5:57 pm

Post by alex »

check this thread, maybe it will help:

http://www.netwu.com/newspro/phpBB2/viewtopic.php?t=130

it doesn't check all headers, when you invoke 'get new headers' it removes the continuous oldest expired headers and downloads new headers. to check in addition all headers (not only oldest but also in the middle) you should run 'rescan headers', it is still faster than downloading all headers anew.

with save database&restart it will save the current state including the task list (it also does it in the beginning of the session if backup is enabled, but it is only the state on the program start). i'm working on database that will provide dynamic automatic backup, it is a part of a wider effort, fault tolerance is not a trivial issue, currently it is the database backup option; when disabled - it is restoring everything but headers without bodies.
Guest

Post by Guest »

A quick question relating to 'rescan headers'. Does this cause all the headers to become 'new' again.
alex
Posts: 4549
Joined: Thu Feb 27, 2003 5:57 pm

Post by alex »

no, only newly incoming headers (a message-id enters the database in the first time) are marked new.

just run the program and check it yourself, all questions that can be easily answered through running the program better to be dealt with that way.
Post Reply