Commit Graph

1371 Commits (634543121b46ce2409e1a88d27a3ceff9e26b171)

Author SHA1 Message Date
orbiter 0c9b61820e enhanced re-crawl settings
19 years ago
orbiter 708cc6c8d9 fixed some bugs for auto-filter and added monitor in profile list
19 years ago
allo c58789177f bookmarkCache
19 years ago
rramthun 250864406f ...
19 years ago
rramthun 42b0b10a95 -Adding Windows Media to types which are not sended compressed
19 years ago
allo 2ed4fa96b7 tagCache
19 years ago
allo 330eb9c74f bookmarkDB cleanup
19 years ago
orbiter e82899ba57 fixed missing urls map initializer
19 years ago
orbiter 63f39ac7b5 added 3 new crawling steering options:
19 years ago
orbiter 1fc3b34be6 some pre-work (without function yet) to implement:
19 years ago
theli c9e6b5e391 *) check size of indexing-queue and crawler pool before processing remote triggered crawl jobs
19 years ago
orbiter 1509314ea6 set tighter control during DHT index and peer selection
19 years ago
hydrox fcc0683200 *) undoing last commit
19 years ago
hydrox 9411961eec *) another little fix for DHT-Transfer
19 years ago
borg-0300 77f3237de3 adapted for isListed()
19 years ago
hydrox 8b14a0c833 *) little fix for DHT-Transfer
19 years ago
orbiter 1f4412a146 adopted isListed to discussed new behavior as discussed (url, getFile)
19 years ago
orbiter 59fc55ea1e added checks to protect peers from wrong seeds
19 years ago
orbiter 063ef4660a bug?
19 years ago
orbiter 82358677a9 added another shiftK2W to flushCacheSome
19 years ago
orbiter 128e4ab199 - in serverSystem: maxPathLength is now a variable, not a method
19 years ago
orbiter a37b09e303 implemented automatic adoption of chunk-read-ahead in kelondroTree to needed chunk size
19 years ago
orbiter 30e3e3a0fd adopted MAXPATHLENGTH to host system capabilities
19 years ago
borg-0300 d808765087 something Javadoc
19 years ago
borg-0300 85bb8e32a1 Bugfix for last commit
19 years ago
borg-0300 3fe402069f try to fix
19 years ago
orbiter f16f1f15cd bugfix for 100% CPU bug; thanks to Matthias for analysis
19 years ago
borg-0300 254a13efd9 MAXPATHLENGTH used
19 years ago
borg-0300 8865948e4e Cleanup;
19 years ago
rramthun 9c85820d35 added MIME-type for wmv and rm
19 years ago
orbiter 6c70f4a0cf renamed wordHashes for a word hash set generation to wordHashSet
19 years ago
orbiter d5f8f40c31 removed correcting iterator
19 years ago
orbiter 526407f32e adoptions, fixes for last commit
19 years ago
orbiter 488a0ed580 replaced old keyIterator and rowIterator by buffered iterators
19 years ago
hermens 4e9a8f41fd rwiDBCleaner + dbImporter: Iterate over small excerpts of
19 years ago
hermens 474379ae63 remove TABs from plasmaDbImporter.java
19 years ago
allo 2b31f51896 bugfix for last commit
19 years ago
orbiter dba02f399f starting of re-design of kelondroTree iterator
19 years ago
allo d2f34a2e94 skin in DATA/HTDOCS (works after upgrade, works when only DATA is writable).
19 years ago
orbiter f02b426073 made kelondroTree.nodeIterator private
19 years ago
borg-0300 5f6fdf1786 Bugfix for getCachePath(URL url)
19 years ago
orbiter 303b6463a8 added debug line to URL storage for testing
19 years ago
orbiter 431a4f3609 eliminated correcting iterator in kelondroTree
19 years ago
orbiter 91dca2cd8d fixed a bug in last commit: LURL entries cannot be written,
19 years ago
orbiter 3286b1f498 re-organisation of lurl-creation and -stacking
19 years ago
orbiter 9cca36a107 no more strict comparator checking in map exclude method if not needed
19 years ago
orbiter 0b903c5317 removed usage of kelondroNaturalOrder from plasmaCondenser to experimental
19 years ago
orbiter 4239db0d1c fixed new ordering for backup iterator TreeSet
19 years ago
borg-0300 399538b7de Bugfix: wrongly compared
19 years ago
orbiter 33eba5ecb8 temporary disabling last change, does not work (cannot debug right now)
19 years ago
orbiter f0464042fc fix for latest iterator-replacement-fix:
19 years ago
borg-0300 ec21c585cb try to fix path too long
19 years ago
orbiter a6a3f4b694 fix for svn 1888
19 years ago
hydrox 8da13088e9 *)removed multiple DHT_Distribution_Threads
19 years ago
orbiter 283a7181c6 try to fix new 100% cpu bug, possibly caused by iterator method
19 years ago
theli 34c075c1c7 testcommit with subversive
19 years ago
orbiter f588c0724f removed cache flush in case of DHT receive
19 years ago
orbiter e94b374d56 update to cache flush method
19 years ago
rramthun 9f979d4fa5 Domain-lists gzip-compressable and sendable via cr-send/receive
19 years ago
orbiter bcd99fe83e introduced a second RAM cache for DHT transfer
19 years ago
hydrox 360a460da8 *)URL-Cleaner: moved logging-statement to correct position
19 years ago
orbiter 02f9765013 quickfix for time problem during cache restore
19 years ago
orbiter 69d26045eb quick-fix for http://www.yacy-forum.de/viewtopic.php?p=18805#18805
19 years ago
allo b3df5ce2b8 another local iprange
19 years ago
hermens ad119f06af *) Don't overwrite new entries with older ones
19 years ago
orbiter be88687d8c fixed some problems with new cache flush karenz
19 years ago
theli d3da7c9a08 *) Adding support for robots Allow directive
19 years ago
theli 734d18f283 *) more correct robots.txt validation
19 years ago
hydrox f046e1814a *fix or last commit
19 years ago
hydrox c55c51e2a8 *)added keywords to IndexCleaner_p.java
19 years ago
theli f0ad0d2b2b *) better robots.txt support
19 years ago
orbiter ddbeda738e added minimum age of word in cache to performance menu
19 years ago
orbiter f188611fc6 apply blacklist on rwis during dht receive
19 years ago
theli 915812f597 *) Undoing robots parser policy changes from svn rev. 1421
19 years ago
orbiter 0ec28b8f8e added DBCleaner from Hydrox
19 years ago
theli 5ee0125046 *) adding possibility to configure the server port for seed uploading via scp.
19 years ago
allo 2065138a41 reverted last Commit.
19 years ago
allo 7afa5c1b8e staticIP fix
19 years ago
allo f6452879d5 prevent nullpointer
19 years ago
theli fb4100d47b *) undoing last commit.
19 years ago
theli a84cc71218 *) removing getTotalRuntime
19 years ago
low012 1965a8cf70 *) bugfix for previous commit
19 years ago
low012 1c3b415c35 *) nicer anchors (TOC)
19 years ago
low012 6000a38a05 *) changed anchors (TOC) according to thelis request in http://www.yacy-forum.de/viewtopic.php?t=1987
19 years ago
auron_x dce08771d1 *) Fix for wrong estimated and elapsed times when import was paused
19 years ago
hermens b34713324a DBImport: remove words from source index even if nothing has been added to home index
19 years ago
orbiter 3237fe1cc7 added IOException for httpc client error
19 years ago
orbiter 520b60f15b fix for http://www.yacy-forum.de/viewtopic.php?p=18610#18610
19 years ago
theli c7ececbfb2 *) httpd.mime: adding jar mimetype
19 years ago
orbiter ae536c4608 fixed soap service: index.soap -> yacysearch.soap
19 years ago
allo a8fa9990aa default skins support
19 years ago
orbiter bae3783d38 added a snippet marking
19 years ago
orbiter f0a38873eb * added yacysearch page with better view on search results
19 years ago
orbiter 3173b5c9b3 fixed port parsing during shutdown for extended port format
19 years ago
orbiter f0041d504d remove of several results from a single domain is stopped if the result set is smaller than the wanted number of results
19 years ago
auron_x b92a00172e *) modified Blog
19 years ago
allo 68ec572df0 bugfix for staticIP
19 years ago
theli 89286478e7 *) removing thread pool eviction for now. Not needed at the moment
19 years ago
theli 759800f543 *) Bugfix for storeHTCache problem
19 years ago
orbiter a4682e2810 fixed problems in basic config and added language setting
19 years ago
orbiter a8548c0484 * several bugfixes regarding basic configuration
19 years ago
orbiter 1b9b8922d9 * fixed problems with new basic 1-2-3 configuration (now authentication required)
19 years ago
auron_x 8c6f38fe70 *) added Blog to YaCy (atm not reachable through interface) -> Blog.html
19 years ago
orbiter c51603a405 added two new kelondro classes that will handle the new index data structures (not used yet)
19 years ago
orbiter ce5274c194 yacybot user agent
19 years ago
allo 3b7e66ab48 staticIP should now work
19 years ago
theli 8558000bd9 *) better handling of port forwarding
19 years ago
allo 32d4c3e4c6 static IP is proper
19 years ago
orbiter f96238e9be cosmetic
19 years ago
low012 d6cc0ec3d8 *) Fixed a bug: Images in tables were not displayed if alt or align attributes were added.
19 years ago
hermens 351bd0a678 *) dbImport: convert cacheSize to kb when creating plasma* objects
19 years ago
orbiter eaffcfefe2 * added more ranking attributes (without function; this will be added later)
19 years ago
orbiter 87e90b9d8c refinements in ram cache flush procedure and default timing
19 years ago
orbiter d31a4e0b4f some small enhancements with cache flushing parameters and data structures
19 years ago
orbiter 3703f76866 - fixed re-search bug: after a search with several words, a second search could not
19 years ago
theli fbbbf5f411 *) remote trigger for proxy-crawl
19 years ago
low012 f31b633b2e *) Fixed yet another small bug in the wiki. (no blank between image URLs, align and alt)
19 years ago
low012 8bdbf0dfff *) Fixed a bug in code for tables and hopefully eliminated XSS vulnarability which Allo pointed out to me.
19 years ago
theli dc9174c809 *) Implementing snippet fetching via ajax
19 years ago
theli 468ca5b0e6 *) Bugfix for url.toString problem in yacyClient crawlOrder
19 years ago
low012 62d0f7a334 *) added TOC for pages in wiki as requested in http://www.yacy-forum.de/viewtopic.php?t=1987
19 years ago
orbiter 1d8ca6e082 serialized dhtChunk deletion with indexing
19 years ago
allo ff476c19a5 tuning User.html
19 years ago
rramthun 013b24ea0d First version of Italian translation by Riccardo Lemmi
19 years ago
low012 2e8221050a *) removed redundancy, no changes in functionality
19 years ago
theli 2336f0f013 *) allow pausing/resuming of crawlJob Threads separately
19 years ago
allo af1da090bb blogRight in UserDB.
19 years ago
borg-0300 2ee5796e76 added keywords, properties;
19 years ago
orbiter 60dac4325e serialized indexing with dht selection
19 years ago
orbiter a840755964 moved parts of index transfer logic back to switchboard
19 years ago
orbiter 134253a603 fixed bug with cache flush
19 years ago
borg-0300 149409ba5c move description -> javadoc
19 years ago
borg-0300 00975359c5 added keywords, properties
19 years ago
orbiter c2d863855d different flush limit
19 years ago
borg-0300 64441b1f78 ADDED: yacy.badwords list to filter the topwords
19 years ago
allo d7da273d7e using ArrayList instead of Vector
19 years ago
allo d6f7bd44ae fix for public tags
19 years ago
orbiter f9063e2040 added some synchronization to avoid that several tasks can trigger a cache flush simultanously
19 years ago
orbiter 2c4e4ae6a2 further refactoring of dht selection, transfer and flushing
19 years ago
orbiter 73dad68cf1 outsourced thelis DHT flush class into own file
19 years ago
allo aa4b04e3dd reverted last change
19 years ago
allo 467216d4c7 bugfix for umlaute and html-specialchars in wikiCode
19 years ago
allo 4b0dae8fcf added a possiblity to get the ranking values for an url.
19 years ago
orbiter 85ac7d8386 * moved DHT transfer thread to own class file, needed for further modularization
19 years ago
orbiter 34341a868e code cleanup
19 years ago
orbiter 7df2e6e571 bugfix for last commit
19 years ago
orbiter cd41e9a0eb moved DHT index selection to new object that holds indexes to be send away to other peer.
19 years ago
allo e3dd67bba0 bookmarks import.
19 years ago
allo dda143df79 We NEED this here for the XML-Files
19 years ago
theli 42a5f56723 *) Bugfix for broken dht thread configuration
19 years ago