boxtec
/
yacy_search_server
mirror of https://github.com/yacy/yacy_search_server
4
1
Fork 0
Code Issues Projects Releases Wiki Activity
6235 Commits
1 Branch
20 Tags
851 MiB
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'eac2daf2e8'
${ noResults }
Commit Graph

4148 Commits (eac2daf2e8b24a364382901d2dd05d925dc60509)

Author SHA1 Message Date
orbiter 6aa474f529 - better logging for web cache access and fail reasons
15 years ago
orbiter 3671c37989 added experimental oai-pmh reader and integrated it with the existing dublin core parser
15 years ago
orbiter 58a00205d5 re-activated the emergency close when too many server connections exist
15 years ago
orbiter c57d2070e6 more logging
15 years ago
orbiter a995b95367 tried a fix for the httpd access bug (too many unclosed sessions)
15 years ago
orbiter e1fba41cad better logging
15 years ago
orbiter 2275f885a8 possible fix for concurrency problem
15 years ago
low012 a6a3090c3d *) blacklist cleaner supports usage of regular expressions now
15 years ago
orbiter 5a93807781 improved web cache speed:
15 years ago
orbiter 2e8b2867ff double performance of store method because it avoids one 'has'
15 years ago
orbiter afda5b1adc new join method for indexes (not yet used)
15 years ago
orbiter 65b66c2c18 better handling of array files of length 0
15 years ago
orbiter 1957b5797a fix for seed generation
15 years ago
orbiter 432154f725 new strategy for concurrent database index key retrieval
15 years ago
orbiter a11cd9f80f - removed reverse name lookup for http access logging (grr..)
15 years ago
orbiter 2e6bdce086 - added more logging to balancer
15 years ago
orbiter 1171a72006 fix for deadlock as seen in http://forum.yacy-websuche.de/viewtopic.php?p=17521#p17521
15 years ago
orbiter 031e6eefbd some updates to dublin core, metadata browsing, file indexing and parser stability
15 years ago
hermens 62a7341c4d Fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2204
15 years ago
low012 f65bfaa9af *) Removed base tag from errror page. This has been added by myself a long time ago as a workaround for some weird behavior of my router, but as it turns out, it does more bad than good in general: If HTTPS is used for communication with YaCy, entering a wrong passwort led to an errror page with a form which would send username and password unencrypted with the user possibly being unaware of this.
15 years ago
orbiter e4797ebcde fix for http://forum.yacy-websuche.de/viewtopic.php?p=17509#p17509
15 years ago
orbiter efa7fb34f0 better oom-awareness of miss-cache in cache
15 years ago
orbiter 3e9dcfc204 fix for http://forum.yacy-websuche.de/viewtopic.php?p=17504#p17504
15 years ago
orbiter c3a4aee255 some redesign with a possible fix for the ReferenceContainerCache.
15 years ago
orbiter aca8a78eb8 fix for shutdown of DocumentIndex objects
15 years ago
orbiter 23ab6fbca4 - navigation appear at correct position when opengeodb-results are also presented after a search
15 years ago
orbiter 4db34eea73 fix for OOM problem in kelondro Cache
15 years ago
orbiter 8ea1d7ab59 fix for wrong assert condition in search abstract generation
15 years ago
orbiter fbd77bd77c git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6328 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter 54c7cbf1d9 - fast result for local search in case that less than 10 hits exists
15 years ago
orbiter 28d4b921b6 different approach for file search
15 years ago
orbiter f99f86c5c5 added concurrency to file indexing class
15 years ago
orbiter 902d16cf6c fixes to parser
15 years ago
orbiter 4a1c852435 fix in usage of RAM copy for Table objects and some cosmetics in asserts.
15 years ago
lotus dce450e2e0 possible fix for "hung" doc-documents
15 years ago
orbiter e627f75415 one more fix to badwords and stopwords
15 years ago
orbiter 721b88efbd - fixed a problem loading blacklists with new yacycore.jar
15 years ago
orbiter 80d5005044 fixed seed upload methods - replaced reflection with direct instantiation
15 years ago
orbiter 68465c37af added a convenience class to add files into a YaCy index
15 years ago
orbiter 2e41e10ffd - updates to yacyVersion parser (remove old targets)
15 years ago
orbiter 27d00285aa - added a new file reader cache that may serve as full-file-copy of blob database files. This is not yet used
15 years ago
orbiter fd6b9cb7dc refactoring of IO access classes
15 years ago
orbiter d64569aa39 reuturn only recommendations of words that have a greater count than the original word
15 years ago
orbiter 604c37927f used comparator for did-you-mean that uses index sizes for comparisment, but:
15 years ago
orbiter a58d9cae7d - show location name in geolocalization search result
15 years ago
orbiter 573d03c7d7 added configuration to enable ram table copy
15 years ago
orbiter 3be54e1891 fix to rule when to use a ram table copy
15 years ago
orbiter 700218846c disabled or removed sleep calls
15 years ago
orbiter 342c5d0fd4 fixed city name detection: finds now also substrings of city names
15 years ago
orbiter 18aa0609ca fix for caching of word hash computation
15 years ago
orbiter a10a6cce45 patch for http://forum.yacy-websuche.de/viewtopic.php?p=17289#p17289
15 years ago
low012 53bbdfd19a *) setting SVN keywords
15 years ago
low012 25f6145934 *) preventing null pointer exception in case empty search word or only one character is enterd or all search words are removed by filters
15 years ago
low012 248f3fd9b5 *) cleaned up code for better readability
15 years ago
orbiter eaddf2d464 - corrected layout of map preview
15 years ago
hermens 4b83875abd Small fixes for the heapCacheIterator in ReferenceContainerCache:
15 years ago
orbiter fd668f531b fixed map layout
15 years ago
orbiter 2740d9dd79 added integration of osm maps for search
15 years ago
orbiter af3a696fc4 added a fast-fail concept in search processes. The search now has better control if all the remote searches may bring any result. If all processes are finished, then all search tasks fail fast.
15 years ago
orbiter ce972ff4ef update to default ranking profile which has now some settings to deny some phpbb3 pages which are redundant in the index when crawling phpbb3.
15 years ago
orbiter 44579fa06d - fixed a problem loading images through yacy's document loader,
15 years ago
orbiter 67eddaec4b changed way to integrate dictionary files:
15 years ago
orbiter d656a94f55 fix for bad paths in dictionary processing
15 years ago
orbiter 3b9aaf9e9f - inserted new library tests inside DidYouMean
15 years ago
orbiter 8c35ffe34c fixes to the dymlib
15 years ago
orbiter bfa273bcc1 added a library provider which holds libraries in static objects,
15 years ago
orbiter 1762a7bcd6 - moved DidYouMean to the data package
15 years ago
orbiter bf8ed00e9e removed debugging code
15 years ago
orbiter ead48c4b25 fix for preparation of search result pages with offset > 10:
15 years ago
orbiter 39a311d608 better care to do not loose the merge/dump thread
15 years ago
orbiter 10d3e856b5 better concurrency, less blocking & performance hacks
15 years ago
orbiter 1a9cfd8718 some performance hacks (CPU only, not IO)
15 years ago
orbiter 92407009b2 cleanup
15 years ago
orbiter 0ba1beaf56 separated rwi constraint evaluation from rwi ranking and added concurrency
15 years ago
orbiter ce7924d712 better concurrency for rwi entry parsing during search processing
15 years ago
orbiter b0637600d5 enhanced url constraint computation: better position of constraint check during retrieval process
15 years ago
orbiter 61748285c3 more refactoring of search
15 years ago
orbiter 323a8e733d removed unused classes
15 years ago
orbiter 72e5407115 refactoring of snippet cache
15 years ago
orbiter 0e471ba33b - fixed a bug in fast digest computation
15 years ago
low012 93b2622503 *) repaired and added IM online status indicators
15 years ago
orbiter e7736d9c8d more refactoring: made all variables in SearchEvent private
15 years ago
orbiter 4b92d0b9b7 patch for possible problems with normalization of '/' in urls. This applies in rare cases when '/' appear in post-properties
15 years ago
orbiter d8ca6e6bf1 more refactoring for search
15 years ago
orbiter fe4a4e3f6b added missing class
15 years ago
orbiter 72ac5bd80f refactoring of search process.
15 years ago
hermens c4d0e22a77 Further speed upof concurrent DHT-receive
15 years ago
hermens 2fbc0696bf Fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2334
15 years ago
f1ori d515bc11e2 added ooxmlparser
15 years ago
orbiter d9744b1b5d replaced old caching strategy control class with lightweight simplearc
15 years ago
orbiter 8e56c2ace6 fix for fixes from this afternoon
15 years ago
orbiter cf739edc2e fix for possible deadlock, see
15 years ago
orbiter 6354b5e447 removed possible deadlock, see
15 years ago
orbiter 5cc17ccf8a a better caching with less overhead and more appropriate
15 years ago
orbiter 92edd24e70 fixed problem with switching of networks
16 years ago
orbiter 0575f12838 fix for deadlock
16 years ago
orbiter fbfdaf063d - patch to omit IndexOutOfBoundsException when a b64-encoded key appears not to be well-formed. In that case the key is still accepted but rated higher than other regular keys to create a virtual ordering between well-formed and ill-formed keys
16 years ago
orbiter c0e17de2fb - fixes for some problems with the new crawling/caching strategies
16 years ago
orbiter 634a01a9a4 replaced wget-requests with caching requests
16 years ago
orbiter c6c97f23ad - added cache usage properties to crawl start
16 years ago
orbiter c4ae2cd03f fixed bug that caused deletion of crawl profiles at every application startup
16 years ago
orbiter 161d2fd2ef redesign of access to the HTCache (now http.client.Cache):
16 years ago
f1ori ba2e6de538 fix empty version string again
16 years ago
orbiter 51534df0cb fix for possible synchronization problem
16 years ago
orbiter 4da9042e8a code simplification
16 years ago
orbiter 1d8d51075c refactoring:
16 years ago
f1ori 67da20647f * add new odf parser based on sax-xml-parser
16 years ago
f1ori 6d0e6d591b * ops, fix compiler error :(
16 years ago
f1ori 3e5beb1654 * fix for empty version in seedlist
16 years ago
orbiter 5bb8074150 removed the indexing queue. This queue was superfluous since the introduction of the blocking queues last year, where documents are parsed, analysed and stored in the index with concurrency.
16 years ago
orbiter 597393db3b changed default visibility of classes/objects in upnp lib
16 years ago
orbiter eea4c17ef2 removed rpm parser
16 years ago
orbiter b332dfad67 - inserted request object into response object which carries this now instead generating new objects
16 years ago
orbiter ca72ed7526 -removed superfluous crawl cache
16 years ago
orbiter 8103ccec4c removed compiler warnings in imported classes
16 years ago
lotus 52e371b8f7 suppress warnings for upnplib code
16 years ago
lotus 477807e0e6 * updated jxpath to latest v1.3
16 years ago
orbiter 13c63f4082 a set of small fixes to crawling behaviour
16 years ago
orbiter a564df3984 update to mime types in parsers and httpd.mime
16 years ago
orbiter 43c8defd79 enhanced parser with more extension + mime attributes
16 years ago
orbiter aee35bff6f replaced StringBuffer with StringBuilder in tar lib
16 years ago
orbiter 49bbb9bd45 replaced tar library with integrated apache ant tar lib
16 years ago
orbiter f987fc6b4a added tar classes from apache ant tools
16 years ago
orbiter b2263bc720 enhanced document type recognition
16 years ago
lotus aa38eb5a20 * maxfilesize -1 for infinite filesize
16 years ago
lotus 9cfe89c8fc * process content-length as soon as it is received
16 years ago
orbiter 50cf80056f removed jmimemagic library
16 years ago
orbiter 3f113f38a8 removed unused imports
16 years ago
lotus 9f083bb6b2 check filetype before loading (no more mp4 loading)
16 years ago
f1ori 076ae02c44 * added pl and py to extensions excepted by htmlParser
16 years ago
f1ori d5e51cfd09 * workaround for non-working build property replacements
16 years ago
f1ori f814e0fa81 enable warnings and fix most of it
16 years ago
f1ori 8931c8d6b4 improvments to debianpackage:
16 years ago
low012 fc1dc38b55 *) added spaces to make sure that no words are concatinated by accident
16 years ago
low012 f242e7d7bc *) using Apache POI library to parse Word documents now
16 years ago
orbiter caedd72400 - enhanced logging and exception details for parsers
16 years ago
orbiter 4b74ad0a46 fixed setting of parser configuration servlets
16 years ago
orbiter 57a88d435b redesign of parser mime type detection and parser steering
16 years ago
lotus e15d27bc63 avoiding double/wrong parser errors
16 years ago
orbiter 21b8704fb4 refactoring of the ParserDispatcher and ParserConfig: resulted into Idiom, Parser and Classification classes
16 years ago
orbiter 8ca1f5d400 - some work to integrate the html parser the same way as the other parsers are integrated (not finished)
16 years ago
low012 1ee109761f *) added changes which were lost
16 years ago
orbiter 499723891d removed all non-http daemons; they had not been used and may be a potential security risk.
16 years ago
orbiter 0e8647d62f refactoring of search classes
16 years ago
orbiter dafffd0153 refactoring of parsers and document processing
16 years ago
low012 8041e91f56 *) Ooops!
16 years ago
low012 69551ff3d9 *) added several MIME types (derived from http://filext.com/), some of them might be rather uncommon
16 years ago
low012 11dfb2d54f minor changes:
16 years ago
orbiter 77d2a3782c removed strange debugging strings
16 years ago
lotus 4320f69574 universal handling for crashed parsers
16 years ago
orbiter 024744245c small refactoring to prepare for new queues
16 years ago
orbiter 16efcd0366 fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2252&hilit=&p=16389#p16389
16 years ago
f1ori 0f3246e90a * fix debian package
16 years ago
f1ori 8544cfd5a6 * remove seperate build-files for parsers
16 years ago
orbiter 24cb6d68bc - renamed Stack to RecordStack to avoid name confusion with new classes
16 years ago
orbiter 995da28c73 all stack/heap files that had been stored in DATA/PLASMA are now stored in the network-specific QUEUES path
16 years ago
orbiter aac89bf8ca trying to avoid "exceeding limit" message of server
16 years ago
f1ori 48d78166ed * fix double copy of libraries
16 years ago
lotus 7f868ca3c2 resource observer: support for yacyroot\DATA on an NTFS hardlink (Windows)
16 years ago
orbiter 409538e17a code cleanup and code simplifcation
16 years ago
orbiter 160031758d fix for problem with initializer
16 years ago
orbiter 302a02cec8 moved all libraries from libx to lib
16 years ago
orbiter 1f1399e5c5 extending visibility of objects and methods to avoid synthetic accessor methods and increase performance
16 years ago
orbiter 154bbc3364 code cleanup: call of static methods directly to the class
16 years ago
orbiter 222850414e simplification of the code: removed unused classes, methods and variables
16 years ago
orbiter 93dfb51fd4 problems with code style
16 years ago
orbiter adf01c676e reduce lookup time when merging a large number of BLOBs
16 years ago
orbiter 9a674d8047 - After the removal of the Tree class some code simplifications are possible. This affects mostly the Records class, which can be refactored and the result of the refactoring results in a reduced number of classes.
16 years ago
orbiter c5122d6836 completed migration of BLOBTree to BLOBHeaps:
16 years ago
orbiter d1083a6913 maybe we have less problems with open connections to the server if we don't do BF forced sleeps (just a test)
16 years ago
low012 ebe6c823ac *) changed svn properties agains (hopefully doing it right this time)
16 years ago
low012 a80ac3a415 *) fixed wrong parser descriptions
16 years ago
low012 457b6c0d6d *) updated Apache POI library to be able to parse Visio files
16 years ago
apfelmaennchen a10c8022d1 DidYouMean:
16 years ago
f1ori 7eb3bff5b3 * workaround for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2220&hilit=#p16128
16 years ago
orbiter 99fa265e1d fix for search bug caused by tenant patch
16 years ago
orbiter 79875782af be a bit more lazy when removing domain navigation entries
16 years ago
orbiter 57af311627 fix for wrong urls in navigator when a tenant is used
16 years ago
lotus 76b96337e2 just some chatty code
16 years ago
low012 91785d895c *) minor changes in comments
16 years ago
orbiter bdda140c02 fix for json output (no doubleqotes any more, doublequote quoting did not work)
16 years ago
orbiter 2f84736120 ignore signature files that cannot be downloaded because of failed encoding
16 years ago
orbiter 041d9c253e some refactoring and more error-awareness in LogalizeHandler
16 years ago
orbiter 6b307d6d59 more tolerance for corrupted index entries in exported row sets
16 years ago
orbiter 33aafa9b4b better logging when writing merged dumps
16 years ago
lotus db70badcf0 possibility to set remote host on upnp device
16 years ago
orbiter 4d29e90708 uaeh
16 years ago
orbiter 3c3e6499ae added more logging for merge operation
16 years ago
orbiter 15180fc95e - patch for future computation in SplitTable
16 years ago
orbiter 9a5ec20b3c avoid merge during startup
16 years ago
lotus bf6b92343c try to avoid stuck pdf parser
16 years ago
lotus c695c7f512 try to remove hung swf parser from queue
16 years ago
orbiter fc69a76197 update to web structure picture:
16 years ago
orbiter ae015e8e98 refactoring of blob package classes
16 years ago
orbiter 8b8877c233 moved image collector
16 years ago
orbiter be1c7ddc64 refactoring of search classes -- moved Ranking Profile to search package
16 years ago
orbiter fd31a3616a - more logging in server process
16 years ago
orbiter 5a7fd6b4c8 just some comment lines
16 years ago
orbiter 31f60a3b3e when doing searches, also apply a online caution to DHT transmission and stop transmissions while heavy load caused by searching. This omits the many requests to the URL database that are needed for DHT transfer and it avoids collisions with URL retrieval needed for search results.
16 years ago
orbiter 17dc6d4be5 small fix for new Logger
16 years ago