You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

orbiter 70dd26ec95 added the new crawl scheduling function to the crawl start menu: ... - the scheduler extends the option for re-crawl timing. Many people misunderstood the re-crawl timing feature because that was just a criteria for the url double-check and not a scheduler. Now the scheduler setting is combined with the re-crawl setting and people will have the choice between no re-crawl, re-crawl as was possible so far and a scheduled re-crawl. The 'classic' re-crawl time is set automatically when the scheduling function is selected - removed the bookmark-based scheduler. This scheduler was not able to transport all attributes of a crawl start and did therefore not support special crawling starts i.e. for forums and wikis - since the old scheduler was not aber to crawl special forums and wikis, the must-not-match filter was statically fixed to all bad pages for these special use cases. Since the new scheduler can handle these filters, it is possible to remove the default settings for the filters - removed the busy thread that was used to trigger the bookmark-based scheduler - removed the crontab for the bookmark-based scheduler git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7051 6c8d7289-2bf4-0310-a012-ef5d649a1542		15 years ago
..
crawler	added the new crawl scheduling function to the crawl start menu:	15 years ago
data	added the new crawl scheduling function to the crawl start menu:	15 years ago
http	patch for http://forum.yacy-websuche.de/viewtopic.php?p=20576#p20576	15 years ago
net	including sbbi upnplib as source again	15 years ago
search	added the new crawl scheduling function to the crawl start menu:	15 years ago
server	more abstraction of the htcache when using the LoaderDispatcher:	15 years ago
tools	... migrating to HttpComponents-Client-4.x ...	15 years ago
yacy	- the web visualization can now be generated in custom color	15 years ago