Commit Graph

3079 Commits (6bdd99e065cd86011bf0a3aaa6de3822720c8aa1)

Author SHA1 Message Date
orbiter 8dd35f74c8 fixed redirect problem (does not work for POST)
17 years ago
orbiter 8313d58ae7 - integrated the collage into the Web Visualization menu
17 years ago
danielr 2617f4dcdb Connections_p.html: better formatting and remove very old entries
17 years ago
orbiter 82bf9ac1c8 - added Collage servlet from datengrab and modified it:
17 years ago
danielr 959f448e5f - disabled redirects in proxy (so client sees real path)
17 years ago
orbiter 8fe39ebd74 -fixed file transmission with POST. The only usage was in ranking transmission, therefore:
17 years ago
orbiter 82a9861779 fix for last commit
17 years ago
orbiter 5d1fbb25e7 fix for bad deploy:
17 years ago
orbiter 202a3adb3e refactoring of HttpClient Writer processes
17 years ago
danielr 8aa9fd8f24 HTTPC with only 1 retry
17 years ago
orbiter 444dce7e81 more performance hacks
17 years ago
orbiter 2c2dcd12a2 - enhanced performance of Eco-Tables: less time-consuming size() - operations
17 years ago
orbiter e356625b22 - refacotring of stream copy handling to support time-consuming operations
17 years ago
danielr f01c50cf8d Proxy logging error (first step to resolution!?)
17 years ago
orbiter c3342e1178 - removed class with only one static method
17 years ago
orbiter f97971b63b fixed NPE problems doing a shutdown from command-line
17 years ago
danielr 7a35126e91 http timeouts von alten httpc wieder gesetzt
17 years ago
orbiter 2c1c3bb6eb - some refactoring (sorry Daniel, hab in deinem Code rumgewütet)
17 years ago
danielr d96e2badc7 - fixed POST in proxy
17 years ago
orbiter 14404d31a8 - enhanced performance graph (more info)
17 years ago
orbiter 696b8ee3f5 fix for http://forum.yacy-websuche.de/viewtopic.php?p=6806#p6806
17 years ago
danielr 94d3d3a86f fixed Proxy (for GET, POST still does not work!)
17 years ago
danielr 081ed1d3ec HTTPLoader: reduced stackTraces
17 years ago
danielr 8b2efb6f8c fixed garbage in HTCACHE
17 years ago
orbiter 225f9fd429 various fixes
17 years ago
orbiter 6e36c156e8 added more logging to EcoFS
17 years ago
danielr fb541f9162 HTTPC: default timeout half-hour
17 years ago
danielr a94f6cdca4 HTTPC: allowed self-signed certs
17 years ago
danielr ab330cfdca Network.html: removed ; from location
17 years ago
orbiter 319144f4b2 fix for outofbounds-excception in EcoFS chunk iterator
17 years ago
orbiter a9cf6cf2f4 generalization of index container-heap class.
17 years ago
orbiter f099061944 protection against bad dht-flush word selection
17 years ago
orbiter 5e4fddc1e6 more logging for new EcoFS.ChunkIterator to find bug for
17 years ago
orbiter 117ae78001 speed enhancement for reading of eco-table indexes
17 years ago
danielr 7c149a4ee8 - undo less 'binary data found'
17 years ago
danielr 96cce8bed9 reduced 'Binary data found' errors
17 years ago
danielr 2aef1414f5 removed test (in yacy.init)
17 years ago
danielr 5c3c1fdf41 replaced httpc with Apache Jakarta Commons HttpClient (includes some refactoring ;)
17 years ago
orbiter daa04f5db9 added additional check in file handler to prevent that url attacks are hidden in url path encodings
17 years ago
orbiter 783a4c9edb strong speed enhancements for the index cache dump and restore:
17 years ago
orbiter 442204a1c8 fix for concurrentModificationException
17 years ago
orbiter d2f4926951 - more logging for balancer to get a hint where the problem is
17 years ago
orbiter 20dadba426 - added a deadlock prevention function in cache flushing
17 years ago
orbiter 764a40e37d speed enhancements for crawler and url retrieval (affects also search speed)
17 years ago
orbiter 3ce3a4a3a1 added stub for new index container heap data structure (purpose: index folding)
17 years ago
orbiter 2c34038912 addition/correction to last commit: usage of concurrent-classes
17 years ago
orbiter b2150057d2 removed unnecessary cleanup method
17 years ago
lulabad c4c0d54b22 * added regex extended blacklistengine
17 years ago
orbiter 368593e449 enhanced the concurrency handling of indexing process (better queue size control, better data concept, better shutdown behavior)
17 years ago
orbiter be58135b3e possible fix for deadlock in search execution
17 years ago
orbiter 0241d070bc added concurrency to indexing process:
17 years ago
lulabad 9fb5d661f2 added my Blacklistengines
17 years ago
orbiter bca87f1e38 - refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads
17 years ago
orbiter 968c775025 - preparation of parsing/indexing queue for concurrent execution
17 years ago
orbiter 9b0e20fb06 next refactoring step in document indexing to prepare concurrency environment for document parsing
17 years ago
orbiter 7f9f639d20 - refactoring and abstraction of index reference (urls) handling: blacklisting is part of reference filtering
17 years ago
orbiter d6050b9ffb - separated the LURL data storage and Crawl result stack for process supervision.
17 years ago
orbiter 8d6a13bc07 refactoring of parsing-condensing-indexing process:
17 years ago
orbiter d3b06913ec protection against seed-db failure during enumeration
17 years ago
orbiter 5aa96dbc36 fix for shutdown configuration
17 years ago
orbiter 93633abed8 - removed some debugging code from search process - should speed up now
17 years ago
orbiter fba46c51d7 fixed non-termination bug in qsort
17 years ago
orbiter 541b817502 refactoring of switchboard queueing
17 years ago
orbiter fc94fbe224 another improvement to the collection sorting
17 years ago
orbiter 11270d450e better quicksort-pivot computation: 30% faster (measured with test program)
17 years ago
orbiter 3e44293f07 - fixed a problem with thread pools in row collection
17 years ago
danielr e43051b125 - fixed Threaddump output (html-escaped ie. <init>)
17 years ago
orbiter 433ff855f7 - fixed another concurrency problem in collection sorting
17 years ago
orbiter 19286fa2d1 tried to fix seed2.old.db-problem
17 years ago
orbiter f3996e63b8 tried to fix more deadlocks:
17 years ago
danielr 7008a218b3 avoid ConcurrentModificationException in plasmaCrawlerQueues
17 years ago
orbiter 7150b463ff changed handling of default values and database paths:
17 years ago
lulabad 25f5035f23 typo
17 years ago
orbiter 7fd094fcbe small bug in ftpc: did cot compile in Java 1.5
17 years ago
danielr f51bad8ae5 FTP:
17 years ago
danielr 820641938e ftpc: fixed date parsing, some refactoring
17 years ago
orbiter 4c584dff87 disabled soLinger to prevent that too many connections stay open (it's a TEST!)
17 years ago
orbiter 9c989fe5f7 fixed deadlock
17 years ago
danielr c565906050 FTP:
17 years ago
danielr 1a7870df0d FTP: source cleanup (added finals, indention for easier diffs)
17 years ago
orbiter fa1090113d - next try to fix the networking problem:
17 years ago
orbiter d87d295c68 one more try to fix the connection problem
17 years ago
orbiter a3dadcd89b preventing that peer which return a false search result are disconnected
17 years ago
orbiter ba622bb240 addendum to svn 4553
17 years ago
orbiter 5530b8e1ca reverted changes to yacy protocol classes: they caused the sciencenet to loose connections
17 years ago
orbiter b664a53553 fix for NPE during search
17 years ago
orbiter b4ed937f1e - modified zone navigation (does still not work correctly)
17 years ago
orbiter 8d0470a5c6 new method to compute search history IDs
17 years ago
orbiter 65785da8f2 new method for best hash computation
17 years ago
orbiter 9eddc1506b - one try to fix the httpd problem
17 years ago
orbiter 7cc4ff05c9 some code enhancements and bugfixes
17 years ago
danielr 6788f8f7c1 fixed error 'FTPC cannot change directory'
17 years ago
orbiter 7ce76c8ff8 added missing file
17 years ago
orbiter bfed9c2da6 - some refactoring in search process
17 years ago
borg-0300 3445b1e10b *better logging
17 years ago
borg-0300 4b0339fec0 *fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=927
17 years ago
orbiter 275a226cc5 refactoring
17 years ago
apfelmaennchen bc3d3b4c97 fixed rebuildTags() to correctly rebuild folders...
17 years ago
danielr fbe335db73 consistent use of de.anomic.server.serverMemory to get information about memory statistics
17 years ago
orbiter 8c06436c4a removing the error-db upon each time a start-up is made.
17 years ago
orbiter 4fdf695064 - fixed a bug in remote search that prevented that any results had been generated (!)
17 years ago
borg-0300 0ddbed9451 Less memory consumption at start
17 years ago
orbiter 1dce2f1079 more multithreading support:
17 years ago
orbiter 6779b455d7 another fix for the punycode parser/generator (should work now!)
17 years ago
orbiter 1b127406d0 update to punycode encoding (still not working)
17 years ago
orbiter 83860507c9 - added punycode class from gnu idn library
17 years ago
orbiter 253a453413 removed possible synchronization deadlock
17 years ago
orbiter 3f321ece7d added a search history to the new search page
17 years ago
orbiter c48e25d784 - fixed selection box for topwords
17 years ago
orbiter 87a8747ce3 - enhanced recognition, parsing, management and double-occurrence-handling of image tags
17 years ago
low012 652086159a *) Replaced System.err.println() by logging function. Left System.err.println()s as comments to be able to quickly revert changes since gzip is an application with it's own main method and Orbiter maybe wants to keep it this way.
17 years ago
orbiter 677ee2ea04 added remove operation to collection index (re-activation)
17 years ago
orbiter d477483373 stronger criteria to use RAM copy to use table copy
17 years ago
orbiter a7abee3578 - fixed some data types in new search stack
17 years ago
orbiter 81687b6bd5 added missing hachCode computation for previous feature
17 years ago
orbiter bedd8dfbe2 - added image sorting by image size. This is the default now.
17 years ago
orbiter 727feb4358 - fixed some bugs in ranking computation
17 years ago
orbiter f4c73d8c68 - fixed highslide usage
17 years ago
orbiter 2327451653 - changed order of database initialisation (index first)
17 years ago
orbiter 3441ec3928 - some small changes to highslide integration to get it working... (does not work yet)
17 years ago
orbiter 6c3cd2b4f2 - added new way to watch images from the image search:
17 years ago
orbiter 61a81820e3 - refactoring of search tracker
17 years ago
lulabad 9ecc17baef fixed double Blog entrys
17 years ago
orbiter 36b898ca7a - tested successfully z-presentation of yacy seed encoding
17 years ago
orbiter 066c88140f quickfix for OOM, see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=875&hilit=&p=5686#p5686
17 years ago
orbiter 4079c38ce0 - probably slightly better default ranking
17 years ago
orbiter 8fd5e52f04 added basket icons and experimental gif animation class
17 years ago
lulabad 94e256e13b * removed single Blogview, now links direct to BlogComments.html
17 years ago
orbiter ff5969901c modified dir servlet to cooperate with intranet indexing from the own HTDOCS repository:
17 years ago
lulabad 00f5f917de - more refactoring to blog
17 years ago
orbiter f890b039ee experiments wit openstreetmaps
17 years ago
orbiter 7f445f34a6 bitte die Java 5 - typischen Warnings einschalten!
17 years ago
lulabad c1b9a03304 * some refactoring to Blog
17 years ago
lulabad 766a04bc06 fixed sort problem in Blog. see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=639
17 years ago
borg-0300 bfe171e693 Small change (generics)
17 years ago
borg-0300 2589290ded better ping
17 years ago
borg-0300 dae9053b21 BUGFIX
17 years ago
borg-0300 77ba446332 seedDB helpers update/cleanup
17 years ago
borg-0300 dd215e7f6b NPE fix
17 years ago
orbiter bd63999801 - faster search: using different data structures that avoid multiplr calculations
17 years ago
lulabad 8358652fa9 some small changes to blog
17 years ago
orbiter 159aaf8889 re-introduced global search limitation when index receive is switched off
17 years ago
borg-0300 a9c4e9c309 Small change (ping)
17 years ago
borg-0300 9ab6ad8b73 more seedDB helpers
17 years ago
lulabad 6a85764e1a Second bugfix for numberbug in Blog.
17 years ago
orbiter efd5807a7c - some renaming of variables to support DC
17 years ago
lulabad 40a0591942 Fixed numberbug in Blog, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=639. This wont fix existing Blogentrys (comes later).
17 years ago
orbiter 141db7ba48 there is less RAM needed for eco table (its just a security-plus for RAM check)
17 years ago
orbiter 249d61759a fix for false RAM table activation in EcoTables
17 years ago
orbiter ff6b69b37e fix for NPE in access tracker
17 years ago
orbiter 3c7b94c119 - fix for online caution delay settings, see
17 years ago
orbiter f35a3794e0 auto-healing (deletion) of bad peer addresses during start-up
17 years ago
orbiter 42c1e11f2b added another link double-check
17 years ago
orbiter a5d388bfff fix for HTCache organisation that may have caused unlimited grow of the cache
17 years ago
orbiter 96c5e6acc7 added a double-check for search results
17 years ago
orbiter a1e9e6e2e6 fix for search result page navigation
17 years ago
orbiter 7404256997 - no more search time-out!
17 years ago
orbiter cd3e0d6f03 tried to fix another eco bug
17 years ago
orbiter 08a12e9bb5 - removed dashed line from default skin (looks much better!)
17 years ago
orbiter 89169d54fd fixed search result preparation
17 years ago
orbiter acf771d5e1 - fixed bug with too much RAM in crawler queue
17 years ago
orbiter a8a5df4a51 - more dublin core naming of page metadata
17 years ago
orbiter fa3b8f0ae1 fixed bug in remote search
17 years ago
orbiter 7d875290b2 more generics
17 years ago
orbiter 9d693ee635 more generics
17 years ago
orbiter 0f5c4abaca more generics
17 years ago
orbiter 974fea7933 added term-frequency ranking
17 years ago
orbiter 1a296af6ff more generics
17 years ago
orbiter 4a80902081 - added ViewProfile as rdf in foaf syntax
17 years ago
orbiter da8c850a25 disabled IO path optimization (seems to block other methods)
17 years ago
hermens d177ceb3b3 Fix for growing responseHeader[12].db when using proxyCacheLayout = hash
17 years ago
apfelmaennchen b1fae9b5af fixed import Netscape Bookmarks
17 years ago
orbiter 2485681002 added termination control for RotateIterator
17 years ago
orbiter e2e7f065e9 minor fixes, some generics
17 years ago
orbiter 15397298dc - refactoring of indexControlRWIs: moved statics to own class; better Dublin Core naming
17 years ago
apfelmaennchen f3a9e9c542 added getFolderList() to bookmarksDB
17 years ago
orbiter db25425893 more generics
17 years ago
orbiter 9e7cd4fdbb more generics
17 years ago
orbiter 4e70dff8cf more generics
17 years ago
orbiter 6dc679785f - fixed bad sort behavior of kelondroRowSet, in this case: no sort at all!
17 years ago
orbiter 0b4205eb5a - fix double-deletion in eco tables
17 years ago
orbiter 4ce6fab428 added special handling for doubles in eco tables after initialization
17 years ago
orbiter 002a109c4d patch for http://forum.yacy-websuche.de/viewtopic.php?p=4597#p4597
17 years ago
orbiter 634430c48a - more logging
17 years ago
orbiter d372a78aef some fixes to bring back lulabads peer..
17 years ago
low012 f4799c2334 *) removed since I decided to turn this into a project of it's own using Perl to gather n-gram data which YaCy will be able to use
17 years ago
orbiter 4ffbcd54a4 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=754
17 years ago
apfelmaennchen e81bced2bd reorganized the code and adjusted getTagIterator() to suit folders
17 years ago
orbiter 85dc62c16f refactoring: more dublin core - compliant naming
17 years ago
orbiter efd0b8371a - added parsing of Dublin Core - compliant metadata (see RFC 5013 and ISO 15836) to html parser
17 years ago
low012 cfd4fecd12 *) blanks in paths for restart and update script are replaced by backslash+blank now (see http://forum.yacy-websuche.de/viewtopic.php?t=745)
17 years ago
orbiter f945ee21d2 some security additions, keep maximum byte[] size to 2^27
17 years ago
orbiter 2f3b2f3481 - extended dbtest for comparisment tests
17 years ago
orbiter 9eb746863d interface enhancements for eco records memory statistics
17 years ago
orbiter 9abc927645 to fix inconsistencies in collection index, a double reference reporting mechanism has been implemented
17 years ago
orbiter 58a1f518f8 fixed some problems with eco tables
17 years ago
orbiter d4d07802ac better RAM protection using eco tables
17 years ago
orbiter f4e9ff6ce9 more generics
17 years ago
orbiter cbefc651ac more generics
17 years ago
orbiter 45339c3db5 more generics
17 years ago