You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

orbiter 70dd26ec95 added the new crawl scheduling function to the crawl start menu: ... - the scheduler extends the option for re-crawl timing. Many people misunderstood the re-crawl timing feature because that was just a criteria for the url double-check and not a scheduler. Now the scheduler setting is combined with the re-crawl setting and people will have the choice between no re-crawl, re-crawl as was possible so far and a scheduled re-crawl. The 'classic' re-crawl time is set automatically when the scheduling function is selected - removed the bookmark-based scheduler. This scheduler was not able to transport all attributes of a crawl start and did therefore not support special crawling starts i.e. for forums and wikis - since the old scheduler was not aber to crawl special forums and wikis, the must-not-match filter was statically fixed to all bad pages for these special use cases. Since the new scheduler can handle these filters, it is possible to remove the default settings for the filters - removed the busy thread that was used to trigger the bookmark-based scheduler - removed the crontab for the bookmark-based scheduler git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7051 6c8d7289-2bf4-0310-a012-ef5d649a1542		15 years ago
..
blob	added the new crawl scheduling function to the crawl start menu:	15 years ago
data	…
index	better memory management and slightly less (in total and temporary) RAM allocation:	15 years ago
io	- enhanced concurrency in database index access for multicore	15 years ago
logging	redirect uncaught exceptions to logging + small other changes	15 years ago
order	…
rwi	better memory management and slightly less (in total and temporary) RAM allocation:	15 years ago
table	- better url double check in crawler	15 years ago
util	added a scheduler based on API actions	15 years ago
workflow	…