Commit Graph

3990 Commits (81035e7080656c7c37b006263eb59fb8d4bf66dc)

Author SHA1 Message Date
orbiter 94b2a664f3 - use a static DiskFileItemFactory (one instantiation is enough)
15 years ago
orbiter 013f337d3f - avoid unnecessary host name lookups for localhost
15 years ago
orbiter 20c5d78a5c fix for a ConcurrentModificationException
15 years ago
orbiter 7144d2df6e added crawlReceipt servlet as individual class to examine OOM problem as documented in
15 years ago
orbiter 29fe436e36 - fixed post-ranking including prefer mask
15 years ago
orbiter 5399d1e2bc refactoring (reason: get more abstraction to use the blacklist class; for integration in other servlets)
15 years ago
orbiter 1fa0ac26e9 better protection against NPEs during search/ranking
15 years ago
orbiter 4c99d4683d possible fix for lost crawl profile handles: clean-up job did wrong measurement to see if crawl is still running.
15 years ago
orbiter 18b21eaffe small fixes to search default values and server logging
15 years ago
lotus 6edc168cfe option to disable dht by memory limit:
15 years ago
orbiter 4431b9767e added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/
15 years ago
orbiter e3025ee691 - new icon for OAI-PMH loading action
15 years ago
orbiter f0b8db93f0 - more abstraction of serverCore thread access
15 years ago
orbiter 2889b9426e missing code for last commit
15 years ago
orbiter b6a8887ff5 better handling of running sessions without explicit hashtable
15 years ago
orbiter 1dc7ea986a added a dynamic keep-alive time-out for http server sessions:
15 years ago
orbiter b0b7a4f9a5 - added function to OAI-PMH reader that can pull all records from a server using an evaluation of the resumption token to get URL to retrieve remaining records
15 years ago
lotus 79251e6f60 configurable disk space hardlimit for dht
15 years ago
orbiter a0e891c63d - some redesign in UI menu structure to make room for new 'Content Integration' main menu containing import servlets for Wikimedia Dumps, phpbb3 forum imports and OAI-PMH imports
15 years ago
orbiter 30f108f97d added stub of oai-pmh importer (not working yet)
15 years ago
orbiter 77c99e500f added more control over memory allocation
15 years ago
orbiter 52470d0de4 - fix for xls parser
15 years ago
orbiter 5e8038ac4d - refactoring of blacklists
16 years ago
orbiter 26fafd85a5 - more refactoring
16 years ago
orbiter 3528b970d6 - refactoring
16 years ago
orbiter a8ce192f63 - shifted main classes to new package net.yacy
16 years ago
orbiter b79f4f062f refactoring of yacy documents and parsers: they depend now only on the kelondro classes
16 years ago
hermens 0fd9540866 Configuration of HTTPDProxyHandler logging
16 years ago
orbiter cee7a05ff2 - de-serialized the pdf parser
16 years ago
orbiter 9db928ce53 replaced fontbox 0.7.3 with fontbox 0.8.0
16 years ago
orbiter c2272785c7 - fix for xlsx and pptx parsing
16 years ago
orbiter c864901087 - moved httpd.mime to defaults path
16 years ago
low012 8829ec5f18 *) made sure that   is replaced with a space and not just deleted in CharacterCoding.java
16 years ago
orbiter 6c347a37eb more options for DocumentIndex
16 years ago
orbiter e7f18ba24b refactoring
16 years ago
orbiter ce8dc575ca refactoring
16 years ago
orbiter bea3b99aff moved table and util classes
16 years ago
orbiter bd876eb4b7 moved io classes
16 years ago
orbiter c0e0e1f422 moved blob classes
16 years ago
orbiter 1e4f8b56ed accumulated classes from different packages into the new rwi package
16 years ago
orbiter 194da25a2f moved kelondro index
16 years ago
orbiter 4446acc8cd moved kelondro order
16 years ago
orbiter f677d534b1 start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root
16 years ago
orbiter ea473e32b8 refactoring
16 years ago
orbiter 735e2737e3 * added index segments
16 years ago
orbiter 09de5da74a once again a performance hack
16 years ago
orbiter 2f6d88403e
16 years ago
orbiter d2615ea5a8 increased memory for scraper buffer to enhance parsing speed
16 years ago
orbiter 4bbbb74ec4 removed not necessary synchronization
16 years ago
hermens 67e5464cc2 Fix for SVN6380: x[] Arrays are unsuitable Keys for Maps without using a proper Comparator.
16 years ago
hermens aeab8c7917 Prevent failed DHT attemps from overwriting newer peer info
16 years ago
hermens 9324b5b6c5 Enhancements to DHT
16 years ago
hermens e49e2d75fe Limit the time Transmission.Chunks stay in the transmissionCloud by using a Map that iterates entires in insertion order.
16 years ago
orbiter 92db7c5d07 increased timeout for index retrieval
16 years ago
lotus 386b9f35f6 activated resource observer for windows 7
16 years ago
orbiter 6e0dc39a7d - some fixes to prevent blocking situations
16 years ago
orbiter 51f2bbf04b possible fix for problem in http://forum.yacy-websuche.de/viewtopic.php?p=17655#p17655
16 years ago
orbiter f8371707e5 - possibly better termination for SplitTable
16 years ago
orbiter 87780f2562 produce did-you-mean also for queries with more than one word
16 years ago
orbiter 04a548a1e3 - temporary integrated the transferURL servlet as static class instead as a class that is called using reflection to investigate the OOM problems in that class
16 years ago
orbiter ea427df944 fixed a worst case situation of the condenser which may cause a temporary full CPU load because of a bad data structure usage
16 years ago
orbiter 3e38035389 fix for interrupted thread during has() property check
16 years ago
orbiter 5bd1c1d205 just added some comments that had been produced to learn about OAI-PMH
16 years ago
orbiter 6aa474f529 - better logging for web cache access and fail reasons
16 years ago
orbiter 3671c37989 added experimental oai-pmh reader and integrated it with the existing dublin core parser
16 years ago
orbiter 58a00205d5 re-activated the emergency close when too many server connections exist
16 years ago
orbiter c57d2070e6 more logging
16 years ago
orbiter a995b95367 tried a fix for the httpd access bug (too many unclosed sessions)
16 years ago
orbiter e1fba41cad better logging
16 years ago
orbiter 2275f885a8 possible fix for concurrency problem
16 years ago
low012 a6a3090c3d *) blacklist cleaner supports usage of regular expressions now
16 years ago
orbiter 5a93807781 improved web cache speed:
16 years ago
orbiter 2e8b2867ff double performance of store method because it avoids one 'has'
16 years ago
orbiter afda5b1adc new join method for indexes (not yet used)
16 years ago
orbiter 65b66c2c18 better handling of array files of length 0
16 years ago
orbiter 1957b5797a fix for seed generation
16 years ago
orbiter 432154f725 new strategy for concurrent database index key retrieval
16 years ago
orbiter a11cd9f80f - removed reverse name lookup for http access logging (grr..)
16 years ago
orbiter 2e6bdce086 - added more logging to balancer
16 years ago
orbiter 1171a72006 fix for deadlock as seen in http://forum.yacy-websuche.de/viewtopic.php?p=17521#p17521
16 years ago
orbiter 031e6eefbd some updates to dublin core, metadata browsing, file indexing and parser stability
16 years ago
hermens 62a7341c4d Fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2204
16 years ago
low012 f65bfaa9af *) Removed base tag from errror page. This has been added by myself a long time ago as a workaround for some weird behavior of my router, but as it turns out, it does more bad than good in general: If HTTPS is used for communication with YaCy, entering a wrong passwort led to an errror page with a form which would send username and password unencrypted with the user possibly being unaware of this.
16 years ago
orbiter e4797ebcde fix for http://forum.yacy-websuche.de/viewtopic.php?p=17509#p17509
16 years ago
orbiter efa7fb34f0 better oom-awareness of miss-cache in cache
16 years ago
orbiter 3e9dcfc204 fix for http://forum.yacy-websuche.de/viewtopic.php?p=17504#p17504
16 years ago
orbiter c3a4aee255 some redesign with a possible fix for the ReferenceContainerCache.
16 years ago
orbiter aca8a78eb8 fix for shutdown of DocumentIndex objects
16 years ago
orbiter 23ab6fbca4 - navigation appear at correct position when opengeodb-results are also presented after a search
16 years ago
orbiter 4db34eea73 fix for OOM problem in kelondro Cache
16 years ago
orbiter 8ea1d7ab59 fix for wrong assert condition in search abstract generation
16 years ago
orbiter fbd77bd77c git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6328 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter 54c7cbf1d9 - fast result for local search in case that less than 10 hits exists
16 years ago
orbiter 28d4b921b6 different approach for file search
16 years ago
orbiter f99f86c5c5 added concurrency to file indexing class
16 years ago
orbiter 902d16cf6c fixes to parser
16 years ago
orbiter 4a1c852435 fix in usage of RAM copy for Table objects and some cosmetics in asserts.
16 years ago
lotus dce450e2e0 possible fix for "hung" doc-documents
16 years ago
orbiter e627f75415 one more fix to badwords and stopwords
16 years ago
orbiter 721b88efbd - fixed a problem loading blacklists with new yacycore.jar
16 years ago