Commit Graph

5179 Commits (29c2289b5c3566b45721e9650685c8b8b49250a7)

Author SHA1 Message Date
sixcooler 29c2289b5c Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
14 years ago
sixcooler 605bc4c10e Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
14 years ago
orbiter aa322bc6d0 fix
14 years ago
orbiter 97d1347adb added also a default accept field to robots.txt downloads
14 years ago
orbiter f183d3822c added a default accept header in http requests since some http fraud detection functions check that this header field exist
14 years ago
orbiter 06352b8d6b more logging
14 years ago
orbiter a99934226e more logging for debugging of robots.txt
14 years ago
orbiter 7a5841e061 fix for robot parser
14 years ago
orbiter 458c20ff72 fix for robot parser
14 years ago
sixcooler e7dedc56f2 Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
14 years ago
orbiter 017a01714d - enhanced logging in robots.txt parser for remote debugging
14 years ago
sixcooler 7545822db5 Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
14 years ago
apfelmaennchen a8dfe787ed - updated to jquery flexigrid 1.1
14 years ago
sixcooler 0aa5e134ea Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
14 years ago
orbiter eb1c7c041d write info about robots.txt evaluation into getpageinfo_p.xml
14 years ago
apfelmaennchen abba31f02e - bugfix for correctly sorting ymarks
14 years ago
sixcooler 3b70ff7046 Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
14 years ago
orbiter 3a15e58e28 - increased stability when opening the robots table
14 years ago
orbiter 775b44017e refactoring
14 years ago
sixcooler c99a4c0920 Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
14 years ago
orbiter e914a30099 fix for npe
14 years ago
sixcooler b92c6bf897 Trying ImageIO instead of awt-Toolkit for parsing
14 years ago
sixcooler db5ef90b0f Merge branch 'master' of https://git.gitorious.org/yacy/rc1.git
14 years ago
sixcooler 3ef9f301ba some customize on Memory-Performance-Graph
14 years ago
sixcooler 8f25070460 weekly rewrite of blobs
14 years ago
sixcooler d6c1ab4e0f some more unreserved characters
14 years ago
sixcooler f522f61af0 clean offline copy of URL Tables
14 years ago
sixcooler 54193457bc cutom keep alive strategy
14 years ago
sixcooler 249a78ff2a G1 Memory Strategy - not used now
14 years ago
sixcooler ccf1583188 cutom keep alive strategy
14 years ago
sixcooler f280e339a8 no force on Memory Request for these parser
14 years ago
apfelmaennchen 5f7dbe1c42 - some refactoring (ymarks)
14 years ago
orbiter 78ce3b13be typo
14 years ago
orbiter 85d6bf4ac4 fixed urls to media content during indexing
14 years ago
orbiter 0d858d48ec replaced String with StringBuilder in suggestion process
14 years ago
orbiter 3a807e10cf - added a cache for active crawl profiles to the crawl switchboard
14 years ago
orbiter 37e35f2741 normalization of url using urlencoding/decoding
14 years ago
orbiter e58438c01c - added a new retry connector for solr (for cases where solr responses are slow)
14 years ago
orbiter d8d9735b4f stability bugfix
14 years ago
orbiter c31564ef08 stability bugfixes
14 years ago
orbiter f121f4bb45 fix for link in Supporter and Suftipps page
14 years ago
orbiter 94eab08794 - updated opensearchdescription text and icon
14 years ago
orbiter 279482a76d fix for npe
14 years ago
orbiter 1b86d06d1e fix for http://bugs.yacy.net/view.php?id=62
14 years ago
orbiter 9e4875230f performance hacks
14 years ago
orbiter eb9c9edb01 enhanced table method (used by almost all yacy api interfaces)
14 years ago
orbiter 4ad9fc2bff new snippet strategy for search hits in metadata: show beginning of text instead of hit position
14 years ago
orbiter a9838f8b99 fix for http://bugs.yacy.net/view.php?id=59
14 years ago
hermens d3df03838a make sure myself-target is always inserted at its appropriate position
14 years ago
hermens c3e7efa846 added sender side prevention of rwi flooding as mentioned in SVN 7993
14 years ago