You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

luccioman 6b45cd5799 New optional crawl filter on the URL a doc must match to crawl its links ... For finer control over which parsed documents can trigger an addition of their links to the crawl stack, complementary to the existing crawl depth parameter.		6 years ago
..
data	New optional crawl filter on the URL a doc must match to crawl its links	6 years ago
retrieval	Added new crawler attribute for finer control over Media Type detection	6 years ago
robots	Small perf improvement : initialize threads names early when possible	7 years ago
Balancer.java	…
CrawlStacker.java	Added new crawler attribute for finer control over Media Type detection	6 years ago
CrawlStarterFromScraper.java	…
CrawlSwitchboard.java	Do not block whole server startup on persisted crawl profile load error	7 years ago
FileCrawlStarterTask.java	removed transformer	7 years ago
HarvestProcess.java	…
HostBalancer.java	Fixed NullPointerException case on malformed crawl queue folder name	7 years ago
HostQueue.java	Fixed crawl queue folder naming for IPv6 hosts on MS Windows filesystems	7 years ago
IllegalCrawlProfileException.java	…
LegacyBalancer.java	…
RecrawlBusyThread.java	Recrawl:	6 years ago