You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 74c249288a added a push api to make it possible to upload files directly without ... crawling to the YaCy indexer. Files are uploaded using POST multipart requests; multiple file uploads are possible as well. Each file has attached the file date and mime type which is used to get the right parser for the submitted data. Also an url is submitted which is assigned to the document. The CrawlSwitchboard has a new option for default Crawl Profiles which are assigned dynamically from the new push interface.		11 years ago
..
data	made number of open files in crawler configurable and increased default	11 years ago
retrieval	refactoring	11 years ago
robots	new Strategies in Balancer:	11 years ago
Balancer.java	…
CrawlStacker.java	added crawl depth for failed documents	11 years ago
CrawlSwitchboard.java	added a push api to make it possible to upload files directly without	11 years ago
HarvestProcess.java	…
HostBalancer.java	made number of open files in crawler configurable and increased default	11 years ago
HostQueue.java	Crawler hostbalancer does not delete finished queue files,	11 years ago
LegacyBalancer.java	special strategy for balancer: do not remove targets with zero wait time	11 years ago