Commit Graph

5153 Commits (cef8ebc41da77caef39da8c71cc68715061a6012)

Author SHA1 Message Date
orbiter eb1c7c041d write info about robots.txt evaluation into getpageinfo_p.xml
13 years ago
apfelmaennchen abba31f02e - bugfix for correctly sorting ymarks
13 years ago
orbiter 3a15e58e28 - increased stability when opening the robots table
13 years ago
orbiter 775b44017e refactoring
13 years ago
orbiter e914a30099 fix for npe
13 years ago
apfelmaennchen 5f7dbe1c42 - some refactoring (ymarks)
13 years ago
orbiter 78ce3b13be typo
13 years ago
orbiter 85d6bf4ac4 fixed urls to media content during indexing
13 years ago
orbiter 0d858d48ec replaced String with StringBuilder in suggestion process
13 years ago
orbiter 3a807e10cf - added a cache for active crawl profiles to the crawl switchboard
13 years ago
orbiter 37e35f2741 normalization of url using urlencoding/decoding
13 years ago
orbiter e58438c01c - added a new retry connector for solr (for cases where solr responses are slow)
13 years ago
orbiter d8d9735b4f stability bugfix
13 years ago
orbiter c31564ef08 stability bugfixes
13 years ago
orbiter f121f4bb45 fix for link in Supporter and Suftipps page
13 years ago
orbiter 94eab08794 - updated opensearchdescription text and icon
13 years ago
orbiter 279482a76d fix for npe
13 years ago
orbiter 1b86d06d1e fix for http://bugs.yacy.net/view.php?id=62
13 years ago
orbiter 9e4875230f performance hacks
13 years ago
orbiter eb9c9edb01 enhanced table method (used by almost all yacy api interfaces)
13 years ago
orbiter 4ad9fc2bff new snippet strategy for search hits in metadata: show beginning of text instead of hit position
13 years ago
orbiter a9838f8b99 fix for http://bugs.yacy.net/view.php?id=59
14 years ago
hermens d3df03838a make sure myself-target is always inserted at its appropriate position
14 years ago
hermens c3e7efa846 added sender side prevention of rwi flooding as mentioned in SVN 7993
14 years ago
orbiter 5af9598bd1 enhanced exported row parsing during row import
14 years ago
orbiter 7598a9e26b fix for thread dump
14 years ago
orbiter 8eef8722d1 update to ThreadDump analysis: freerunner and thread state recognition
14 years ago
orbiter 1df43b137d another performance hack
14 years ago
orbiter 7df0643f0e performance hacks
14 years ago
orbiter a7df70221e refactoring
14 years ago
orbiter 1b45e33f04 added robots tag parser to solr scheme
14 years ago
orbiter cf4fd525ee added directDocByURL attribute in crawl profile
14 years ago
orbiter c61e4cfd78 - fix for incomplete clear() in balancer
14 years ago
orbiter 813f297a95 another performance hack: re-use of known host addresses for isLocal property; avoids look-up in local hash
14 years ago
orbiter 035ebfbf3b - performance hacks (should affect the crawl balancer and reduce CPU load during crawl stack re-fill)
14 years ago
orbiter b250e6466d implemented crawl restrictions for IP pattern and country lists
14 years ago
f1ori e207c41c8e * fix urlproxy for urls containing dolar signs
14 years ago
orbiter 57d5529a01 performance hacks
14 years ago
orbiter 5ad7f9612b added crawl settings for three new filters for each crawl:
14 years ago
orbiter 47a8c69745 added a new feature to MultiProtocolURIs to get the locale for each url:
14 years ago
orbiter 2c3161b4ac refactoring:
14 years ago
orbiter d2ea250d99 refactoring:
14 years ago
low012 42b5f09f68 *) this should fix a bug in snippet creation (also cleaned up a little bit)
14 years ago
low012 277b454a62 *) added comments
14 years ago
orbiter 6b22865dbc - removed some warinings
14 years ago
orbiter 0c6d95e57b - more tolerance against failure of table opening
14 years ago
orbiter 4f31869c5a enhanced search result timing
14 years ago
orbiter 6b02b696b0 - add number of search results to end of rss and json output to reflect latest status of retrieval
14 years ago
f1ori 87e6abd168 * fix urls containing a port number in urlproxy
14 years ago
f1ori 97045022fa * pass cookies to Server Side Includes
14 years ago