Commit Graph

382 Commits (44874f2cb9e0c324ae24c33f479f94836d2cc3df)

Author SHA1 Message Date
orbiter d2fd93135c - moved yacybot user agent string definition to MultiProtocolURI since there are basic access mechanisms where the bot string is needed
15 years ago
orbiter 48c0d508ac fixes for crawling of smb links (file length not always available)
15 years ago
f1ori e670e1ef8e add charset auto-detection for htmlParser
15 years ago
f1ori ddcd5ae78c fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2989
15 years ago
f1ori 8fe1102452 fix http://forum.yacy-websuche.de/viewtopic.php?p=20889#p18426
15 years ago
orbiter 10a9cb1971 simplified snippet computation process and separated the algorithm into two classes
15 years ago
orbiter 84a023cbc8 fixed several search bugs
15 years ago
orbiter 09c208a3ab patch for corrupted database files (just work on and forget key)
15 years ago
orbiter 97ee278931 enhanced search speed:
15 years ago
f1ori b392ca5024 * add option to show YaCy version, usage:
15 years ago
orbiter ac73072924 added a demonstration class: integrate the YaCy search results in own applications
15 years ago
orbiter 8da4eb5de6 addition to patch in SVN 7111
15 years ago
orbiter 37baa8bae3 - fixes for concurrency exceptions and failed database integrity verification
15 years ago
orbiter 461a2a6ec7 enhanced remote crawling:
15 years ago
orbiter 0cf006865e refactoring and enhanced concurrency
15 years ago
orbiter 83ac07874f - corrected return value of put() methods (not used anywhere, so it did not harm before)
15 years ago
orbiter 5702419194 fixed a bug in HTTPClient: keep-alive must be set to false, otherwise servers hold connections 2 seconds open until response.
15 years ago
orbiter 5870b13f3a - code cleanup / added debug line for further investigation in HTTPDemon.parseMultipart
15 years ago
orbiter ac1c08924e more performance hacks
15 years ago
orbiter 14c843d364 more performance hacks
15 years ago
orbiter 39f409a7bb performance hacks
15 years ago
orbiter 3c0e07ba72 removed all delays in shutdown process
15 years ago
orbiter 906c572621 - enhanced index create menu structure
15 years ago
orbiter 64860dc1bb enhanced search event logging (to be used for further improvements)
15 years ago
orbiter 7dbc357593 patch to identify corrupted database files
15 years ago
sixcooler 17eebd4ef8 counting crawler traffic again:
15 years ago
lotus d2a3d08c44 avoid div. by zero
15 years ago
orbiter 2c7edea35e - better shutdown behavior for the GUI (waits until data is written if GUI is killed)
15 years ago
orbiter 34a25856a5 - added navigation to next/prev search page using arrow keys (left/right)
15 years ago
orbiter 32f73d1aaa added copy for Info.plist for Mac application release updates (this file contains class paths and start parameters)
15 years ago
orbiter 4c21d8dc9d - changed default values for online caution (the pausing may not be necessary any more)
15 years ago
orbiter 570ca577c6 performance hacks
15 years ago
orbiter 348dece62f redesign of the SortStack and SortStore classes:
15 years ago
hermens 03eb021568 Fix for byte[] Objects as keys
15 years ago
orbiter 114bdd8ba7 fixed old sitemap importer which was not able to parse urls containing post elements
15 years ago
orbiter c0b08ac59b slighlty changed way of pdf parser integration
15 years ago
orbiter 6d83c7cb62 removed unnecessary Override statements (produces errors in strict validation)
15 years ago
orbiter 5fe828fa06 - replaced pdfbox and fontbox version 1.1.0 with 1.2.1
15 years ago
orbiter 24502fe3de performance hacks
15 years ago
orbiter ffaa9a1c51 avoiding double-loading of the same resource from the web in case that a seond attempt to load the resource is started while the first attempt is still loading the content from the web. This will delay the second attempt to the time when the first attempt has finished with the possible result that the second attempt reads only from the web cache, not from the web.
15 years ago
orbiter d865ef77a8 removed re-read of index in case of a bad index. This may not solve the problem but it applies a 100% CPU problem on the peer. I'm afraid bad index files must be abandoned, and cannot be fixed this way.
15 years ago
orbiter b2c9db48ea Performance enhancement
15 years ago
orbiter ae07e11bc5 enhanced image search result display: concurrent loading of images before they are displayed
15 years ago
orbiter 22047ffad5 enhanced computation speed of many replaceAll string operations
15 years ago
orbiter e8228fba09 less locking in time format computation, caching and during secondary (remote) search evaluation
15 years ago
orbiter 9c0c94683c because of a bug in search result caching count search results had not been generated as fast as possible.
15 years ago
orbiter b3f0d06444 fixed a problem with restarts in YaCy mac applications: the DATA directory path was not submitted when doing a restart. This solves the problem by:
15 years ago
sixcooler ca0a03e9ea ... migrating to HttpComponents-Client-4.x ...
15 years ago
orbiter 3988a95fb5 added ability in rss reader to parse atom feeds
15 years ago
orbiter 9d080f387e change in handling of the all-visible home path for storage in YaCy:
15 years ago