Commit Graph

182 Commits (7a3c19846fcd28c20385b6d0350bf33857f94d57)

Author SHA1 Message Date
orbiter 1e8e79b9ef redesign of reference hash (URL-hash) parameter hand-over: 15 years ago
orbiter 72d8e9897b removed unnecessary cache flush call in backend of BufferedRecords 15 years ago
orbiter 749ffbd642 - added another catch case for the index dump and index merge process that should cause non-blocking behavior in case that index dump and/or index merge caused any unexpected exception. 15 years ago
orbiter 9ddb8e4a43 set an option for the java-internal image parser that prevents that the image is cached using the file-system in a temporary file. This should speed up image parsing during image indexing dramatically and should also cause better performance when showing the yacy banner and OSM tiles. 15 years ago
orbiter 312ca5d917 removed flush at end of every rwi entry since this reduces the write performance. 15 years ago
orbiter 0018163c07 moved table row/column matching method from front-end to back-end 15 years ago
orbiter 31e29a8831 - removed synchronization during index dump and index cleaning 15 years ago
orbiter 6c093d6aed - enhanced domain navigator computation 15 years ago
orbiter bb63c5d075 using a Pattern object with precompiled regular expressions to apply must-match constraints to search results: should speed up pre-sorting of search results and should cause richer search result sets 15 years ago
orbiter e0da0a84b0 performance fix in http parser 15 years ago
orbiter 90dd197ae7 - no latency for local crawls 15 years ago
orbiter bfb518cd47 some refactoring to get the LoaderDispatcher a little bit more independent from the switchboard 15 years ago
orbiter 36bd843ece for for RFC5322 comformance as suggested by Quix0r in http://forum.yacy-websuche.de/viewtopic.php?p=19585#p19585 15 years ago
orbiter 748abfcffa added patches to prevent yacy-protocol DoS settings 15 years ago
orbiter e820ed061a avoiding excessive DNS lookups to determine localhost 15 years ago
orbiter 11983bc936 redesigned some parts of the parser entry point: 15 years ago
orbiter 89b4fff1c2 adopted ant script for new exif library 15 years ago
orbiter 24e5faee75 added exif parsing for jpg images 15 years ago
orbiter 82f76e1296 removed log line 15 years ago
orbiter 0f8004f9da enhanced html parser to recognize a href tags inside header tags 15 years ago
orbiter 3300930fc5 - (almost) fixed FTP crawler 15 years ago
orbiter 1198b9989d bugfixes, more sorttable 15 years ago
orbiter 9623d9e6d2 added a smb loader component for the YaCy crawler 15 years ago
orbiter ae2f3f000f better handling of table copy abandon .. prevent memory leak 15 years ago
orbiter 0769517129 added a robots.txt monitor in the crawler monitor submenu 15 years ago
orbiter 72f00dee59 removed never-used server access account function 15 years ago
orbiter de01fe0e6d fix for bug in url parser 15 years ago
orbiter c4bdb1e7f2 added one more option in ViewFile to show an iframe like for the orginal web page content but using the cache than the direct link to the content in the web. Upgraded the very old and previously not any more used CacheResource_p servlet to a new and working version. 15 years ago
orbiter 1bbe14d23f SVN 6716 unfortunately contained parts of the unfinished SMB integration. To fix compile errors the remaining parts of the SMB implementation stub is added with this commit. 15 years ago
orbiter 884b262130 - added a new Wiki Namespace Navigator 15 years ago
orbiter 270fb38674 - fixed some bugs in Table viewer 15 years ago
orbiter 727dd9b193 - fixed a bug in robots.txt parser 15 years ago
orbiter 54af9e6b49 - added parsing of robots meta-tag in html headers to detect a noindexing request 15 years ago
sixcooler cd6de83905 next try for for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2703 15 years ago
sixcooler bfe4693e9a fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2703 15 years ago
orbiter 564927ce72 redesign of CrawlResult data structures because of OOM occurrences during URL deletion processes. 15 years ago
orbiter 30c8185139 fix for sid check 15 years ago
orbiter ef62d017e5 integrated session id filtering for crawler 15 years ago
orbiter d8d9984913 added framework for session id filtering (not ready yet) 15 years ago
orbiter 2bc36de336 - fix for bug in svn 6669 15 years ago
orbiter d378ca4604 better handling of concurrency in seed 15 years ago
orbiter 6538043d89 fix for http://forum.yacy-websuche.de/viewtopic.php?p=19189#p19189 15 years ago
sixcooler e071d71f19 fix for yacy-banner-network-values 15 years ago
sixcooler 787b588c33 reverted a part of svn6636: 15 years ago
lotus 11188cd7eb resource observer now uses the Java 6 method to check for free space. thus, disk observing now needs Java 6 installed. 15 years ago
sixcooler 089877f32c my first commit - hopefully fix for merge problem 15 years ago
orbiter d6391f2537 better handling of rewrite cases where the resulting rewrite blob entry is equal in size 15 years ago
orbiter ef9473d92c added another sixcooler suggestion: recycle corrupted records 15 years ago
orbiter fe78edac32 - view API calls in correct date-order 15 years ago
orbiter 308a973503 refactoring of tables data organisation 15 years ago