You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

orbiter f183d3822c added a default accept header in http requests since some http fraud detection functions check that this header field exist ... see also: http://bad-behavior.ioerror.us/ in source file browser.inc.php git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8048 6c8d7289-2bf4-0310-a012-ef5d649a1542		13 years ago
..
FTPLoader.java	refactoring:	14 years ago
FileLoader.java	refactoring:	14 years ago
HTTPLoader.java	added a default accept header in http requests since some http fraud detection functions check that this header field exist	13 years ago
Request.java	- performance hacks (should affect the crawl balancer and reduce CPU load during crawl stack re-fill)	14 years ago
Response.java	added new configuration property "crawler.embedLinksAsDocuments". If this is switched on (this is default now), the all embedded image, audio and video links from all parsed documents are added to the search index as individual document. This will increase the search index size dramatically but will also enable us to create a much faster image, audio and video search. If the flag is switched on, the index entries are also stored to a solr index, if this is also enabled.	14 years ago
SMBLoader.java	refactoring:	14 years ago