Commit Graph

3120 Commits (3768a1bd32ac7d7a842dc273a3322e3d33bcd095)

Author SHA1 Message Date
apfelmaennchen 5e8bd0f29c small fixes to getpageinfo_p.xml and htmlFilterContentScraper.java with respect to keyword extraction
17 years ago
apfelmaennchen 5b2a57bfd0 - /xml/util/getpageinfo_p.xml added <desc> and <lang> tags
17 years ago
orbiter e1f67262f7 - added and removed some debugging output
17 years ago
orbiter ce2a7ed116 integrated language detection classes into condenser environment
17 years ago
orbiter 2b13705839 fixed a mistake in indexing queue processing: documents had been parsed before it was checked if they should be indexed or not. parsing was not necessary for this check, so the check was moved in the queue in front of the document parsing
17 years ago
orbiter 21dbb39afa switched two balancer cases
17 years ago
orbiter 1bbf362cef update to the crawl balancer: better organization and better crawl delay prediction
17 years ago
orbiter ddcf285499 - fixed a bug in performance setting (did not work with german translation)
17 years ago
orbiter 0cd0fee546 fixed bug with wrong proxy result enqueueing. See:
17 years ago
orbiter 670244849d fix for http://forum.yacy-websuche.de/viewtopic.php?p=9835#p9835
17 years ago
lotus fd9233244e configurable free disk space via disk.free
17 years ago
orbiter 25a62cdc3f small fixes
17 years ago
lotus 73f233bb11 * set resource observer to 1000MB
17 years ago
orbiter 5fbccfd75e fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1366&p=9348#p9348
17 years ago
orbiter a28faabfd2 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1351&p=9242#p9242
17 years ago
apfelmaennchen 7b63c66a08 - bugfix in bookmarksDB.Tag.hasPublicItems()
17 years ago
orbiter 1fb1665e71 increased dht interval to avoid peer selection failure
17 years ago
orbiter 1eb813bd43 shifted index deletion-on-exit rule to the class where the errors are produced
17 years ago
f1ori ba76995d2c * fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1415
17 years ago
f1ori bea6c13139 * with r5137 robotParser didn't work at all -> fix
17 years ago
lotus 3ded1efe84 kelondroExceptionCounter didn't work
17 years ago
f1ori ae677e1738 * fix problem in robotparser, see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1421&p=9742
17 years ago
lotus 383d89481e count errors before deleting collection.index
17 years ago
lotus 0bb4fbc403 delete corrupted collecion.index on exit for rebuild on next start
17 years ago
lotus b68d06a6e8 performance settings based on network's remote crawl speed
17 years ago
danielr d60b2b198d proxy fixed 'not modified' http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1419
17 years ago
f1ori bd0318ba81 * YaCy only supports gzip-encoding, so remove any other encoding from request
17 years ago
orbiter bb5c898441 enhancements to localsearch behavior
17 years ago
orbiter 42e2d195ac added hint from http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1294
17 years ago
orbiter 39964e88fa fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1329#p9121
17 years ago
orbiter 3f3673b6e5 extended balancer:
17 years ago
orbiter 3c6e8d2015 set default ppm when network is switched
17 years ago
orbiter 3288c19c1a reduce remote crawl PPM for fresh peers in freeworld to 6 PPM
17 years ago
lotus 5ce9a100bb fix(2) for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1416
17 years ago
danielr cf29ca19d4 possible fix for POST character encoding http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1374
17 years ago
danielr a2eeb6138c fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1416
17 years ago
orbiter d09ddabd09 corrected a design mistake (5-byte hashes not necessary)
17 years ago
orbiter c97d0fcee7 modified the domain list export function:
17 years ago
orbiter 77ee0765a4 - added domain statistic generation to IndexControlURLs_p.html servlet
17 years ago
orbiter 80a7bc93d6 - added statistical evaluation about domains that appear during crawling
17 years ago
orbiter 4fbee21cea - added fetch-ahead again (had been removed in last commit)
17 years ago
lotus 423a89ebe8 * fix if yacy was installed to a path with whitespace
17 years ago
orbiter fc03b0437a fixed a error case where a second search after a first search with a different search word failed
17 years ago
orbiter eca171ba2e fix for case where javascript was not filtered by the html parser
17 years ago
lotus e645bae29f display table in log
17 years ago
orbiter ead39064c5 fixed problem with wrong result number calculation
17 years ago
hermens 2437beb96c fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1360&p=9321#p9321
17 years ago
orbiter 7b12e77a63 fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1393&hilit=&p=9655#p9655
17 years ago
orbiter 05dbba4bab added logging conditions to all fine and finest log line calls
17 years ago
orbiter d3d41e2ee4 - fixed problem with searching with quotes (still not complete, but not as bad as before)
17 years ago