Commit Graph

5793 Commits (f00168ecc506b10933167bac2c8187f9cc7abccb)

Author SHA1 Message Date
Michael Peter Christen 826967513b changed options in IndexFederated_p to switch on/off parts of the index
12 years ago
Michael Peter Christen cba4ab862e fix for http://bugs.yacy.net/view.php?id=202
12 years ago
orbiter 69e743d9e3 - more abstraction for the RWI index as preparation for solr integration
12 years ago
orbiter 05a3ffd03a patches to ensure that solr connectors are active ony if they have a
13 years ago
orbiter 5a3c829872 embedded solr is only initiated if it is activated with
13 years ago
Michael Peter Christen 97b7bcf2a6 added a solr search index
13 years ago
Michael Peter Christen f0a079ac9f allow larger log entries
13 years ago
Michael Peter Christen 9b48c9fe2e removed a crawler overhead (terminated loop which searches greatest
13 years ago
Michael Peter Christen 784a4abb18 enhancement in internal data organization which should generate less
13 years ago
Michael Peter Christen f78ce93a80 collection of speed and memory saving hacks
13 years ago
orbiter c00a3cf74d less usage of generic logger to avoid logger generation overhead
13 years ago
orbiter a196f24f60 prevent enqueueing of non-loggeable logging entries
13 years ago
orbiter 482afed07c reduced logging overhead (a bit)
13 years ago
orbiter e76159040b Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
orbiter bbfa497a3c replaced more size() > 0 by !isEmpty()
13 years ago
Michael Peter Christen 58e7d1952f reduction of logging to prevent too much IO caused be logging
13 years ago
Michael Peter Christen 83da68c4c1 fixed a memory leak inside the logger which appeared if the log was
13 years ago
orbiter 0cbda0b2b8 - replaced all length() == 0 and size() == 0 with isEmpty()
13 years ago
orbiter 28b30231c3 fix for url matcher of multiple amp& in an url, see:
13 years ago
Roland 'Quix0r' Haeder aef9dd0350 - removed cleaning of blacklist cache on startup
13 years ago
orbiter c7afa8bc48 using SwitchboardConstants for solr attributes
13 years ago
orbiter c6d8950651 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
orbiter 5f3b8dc040 fix for RSS reader
13 years ago
orbiter 62202e2d71 refactoring of query attribute variable names for better consistency
13 years ago
Michael Peter Christen 1addbc792c use less memory for md5 cache
13 years ago
Michael Peter Christen f32de94723 more logging
13 years ago
Michael Peter Christen d09d9f2364 filter old peers from bootstrap (now stronger: 60 minutes instead of
13 years ago
Michael Peter Christen 434ee90c59 added classification for control file types which shall not be loaded
13 years ago
Michael Peter Christen a90bcb48f6 added webm
13 years ago
Michael Peter Christen 801972fe6f fix for url camel case parser and sentence reader
13 years ago
Michael Peter Christen fbc1a2030d fix for sitemap importer: can now also import very large sitemaps within
13 years ago
Michael Peter Christen 92731e5287 fix for sevenzip parser
13 years ago
Michael Peter Christen 45641b0c23 catch and log a warning in RasterPlotter
13 years ago
Michael Peter Christen 8efc1c1078 - fixed a memory leak (or bad usage) during parsing/snippet fetch
13 years ago
Michael Peter Christen c3db015410 prevent loading of content from the cache when retrieval with IFFRESH is
13 years ago
Michael Peter Christen b1e7c11fba fix for pattern matcher in html parser
13 years ago
Michael Peter Christen 8a6edc0031 fix for solr shutdown
13 years ago
Michael Peter Christen b8bcc06283 fix for urls beginning with "//"
13 years ago
Michael Peter Christen b0c408788b made class methods static where possible
13 years ago
Michael Peter Christen 5bd3c90907 - removed unnecessary semicolons
13 years ago
Michael Peter Christen 132afaf687 removed unaccessible code
13 years ago
Michael Peter Christen 7c1ba99755 removed more unused method parameters
13 years ago
Michael Peter Christen 83701a1b4c removed unused ImageReference package
13 years ago
Michael Peter Christen 0301aba1e9 removed unused method parameters
13 years ago
Michael Peter Christen 241dd8410a removed snippet pattern filter - it was not used
13 years ago
Michael Peter Christen d3964253ae - added @SuppressWarnings to unused servlet method parameters
13 years ago
Michael Peter Christen ea10766bfd cleaned unnecessary nested code
13 years ago
Michael Peter Christen 1481037820 replaced non-generic array with collection
13 years ago
orbiter fc0f9543fe More SentenceReader cleanup
13 years ago
orbiter 586bb0eb6a Simplified SentenceReader (no more Reader inside..)
13 years ago
orbiter 7f851d62a7 replaced HashARC with SizeLimited Objects which are less costly
13 years ago
orbiter d4291ac1f3 more tolerance when creating solar document
13 years ago
orbiter 78fc3cf8f8 refactoring and new usage of SentenceReader: this class appeared as one
13 years ago
orbiter bb8dcb4911 automatically adopt size of word cache to available memory
13 years ago
Michael Peter Christen ad09b786bf clean up parser data
13 years ago
Michael Peter Christen 276a66a793 Adding a limit of 1000 links that a parser shall store during indexing.
13 years ago
Michael Peter Christen 613b45f604 - better data structures in secondary search
13 years ago
Michael Peter Christen de903a53a0 parser refactoring & hacks
13 years ago
Michael Peter Christen 8a82609360 - smaller caches to save memory
13 years ago
Michael Peter Christen 7249d9c9de bugfix for concurrent seed loader
13 years ago
Michael Peter Christen c72d3b12cd concurrently initialize the seed list during p2p network bootstrap
13 years ago
Michael Peter Christen 1825f165b8 better integration of blacklist according to use case
13 years ago
Michael Peter Christen c18fa9fa75 Merge branch 'master' of git://gitorious.org/~reger/yacy/bbyacy-rc1
13 years ago
Michael Peter Christen ce8d4b87d9 fixes for new eclipse 'Juno' warning 'Resource leak'.
13 years ago
Michael Peter Christen 0c345d1559 giving threads name so its easier to see whats happening during
13 years ago
reger 067728bccc add search result heuristic. adding a crawl job with depth-1 for every displayed search result (crawling every external linked page of displayed search result pages)
13 years ago
Michael Peter Christen 03280fb161 removed segments-concept and the Segments class:
13 years ago
Michael Peter Christen 508a81b86c added solr field 'refresh_s' which stores the refresh url contained in
13 years ago
Michael Peter Christen f3167def64 do not fill the keywords with title content if keywords do not exist.
13 years ago
Michael Peter Christen 9116013c64 - allow lazy initialization of solr value (if using 'lazy', then no
13 years ago
sixcooler 97f60010d8 fix crawl start from file
13 years ago
Michael Peter Christen 0294a53459 - add canonical field only if requested by solr schema
13 years ago
Michael Peter Christen 3fd4a01286 added option to record urls that are forwarded to the solr index
13 years ago
Michael Peter Christen d763e4d94b fixed bad referer computation in SSIs which causes a NPE during host
13 years ago
Michael Peter Christen 358b04885e more IPv6 hacks
13 years ago
Michael Peter Christen 96aeb127e3 generalized localhost naming.
13 years ago
Michael Peter Christen 77f795756c fixing redirects and status codes: storing of status code in
13 years ago
Michael Peter Christen 8dd469b9dd added option to configure the autocommit delay time of solr on-the-fly
13 years ago
Michael Peter Christen b9dfca4b0a - fixed IndexFederated Servlet / a embedded Solr can now be selected
13 years ago
Michael Peter Christen fad3b14813 added jetty libraries, needed for future use as web server and as
13 years ago
Michael Peter Christen a38b0a2c46 extended embedded solr tests to ensure that it will be usable within a
13 years ago
Michael Peter Christen b9d42fd9c8 using com.google.common.io.Files instead of homebrew methods
13 years ago
Michael Peter Christen a5eb91fa60 refactoring
13 years ago
Michael Peter Christen 1be0025a9c - added test for EmbeddedSolrConnector
13 years ago
Michael Peter Christen dbdd697f4d moved RDFaParser.xsl configuration file to defaults
13 years ago
Michael Peter Christen 90b82ce994 using guava for host resolution (non-blocking for ips) and time-out
13 years ago
Michael Peter Christen e12bb254b4 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
Michael Peter Christen 3f55dc7c1e - added solr core and libraries that solr needs (lucene is missing, will
13 years ago
Michael Peter Christen c337190a00 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
cominch c63c3a4495 Show additional interaction elements in footer section on each page, if
13 years ago
Michael Peter Christen 786be7d175 better integration of RDFaParser
13 years ago
Michael Peter Christen de3ef8ad73 removed unimportant warnings
13 years ago
Michael Peter Christen 82a682b31d fixed problem with seed when switching network
13 years ago
Michael Peter Christen 8c544edee4 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
Michael Peter Christen 7dc59979bc fix for npe, possibly for http://bugs.yacy.net/view.php?id=195
13 years ago
Michael Peter Christen 1d4e206b2b bugfix in vocabulary generation
13 years ago
cominch 2c89975378 Merge remote-tracking branch 'original yacy/master'
13 years ago
Michael Peter Christen 52f5d40043 better abstraction of document model generation
13 years ago
Michael Peter Christen 8b7c4d3144 produce a rdf output containing the triplestore with yacydoc; ie:
13 years ago
cominch f7160dae5c Merge remote-tracking branch 'original yacy/master'
13 years ago
cominch e4555cbee3 Augmented browsing: Pass on additional action parameter
13 years ago
Michael Peter Christen 24bbe359ca integrate also geonames library files for less cities. these are more
13 years ago
Michael Peter Christen 223a5440ab preventing that an empty pnd is inserted into the vocabularies
13 years ago
Michael Peter Christen 8e97ada7c9 IPv6 bugfix
13 years ago
Michael Peter Christen 963f92ed9a - merged files
13 years ago
Michael Peter Christen dd88d0ace2 more logging
13 years ago
Michael Peter Christen 94d54e2d91 added recognition of multi-word terms in vocabulary matching
13 years ago
Michael Peter Christen 64c0268b2b show triplestore metadata in yacydoc and viewfile
13 years ago
Michael Peter Christen 0fbd749207 ipv6 update
13 years ago
Michael Peter Christen c2f0d16d2c fixed vocabulary initialization
13 years ago
Michael Peter Christen fbded1f466 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
Michael Peter Christen df3531f8d5 added the generation of virtual vocabularies using the pnd
13 years ago
Michael Peter Christen e806106b10 jquery bugfix
13 years ago
Michael Peter Christen a0f1decd82 - added loading of the dbpedia pnd triplestore in the dictionary loader
13 years ago
cominch 2ac7a5c1f2 Augmented browsing: Add overlay bar which shows the vocabulary tags
13 years ago
cominch 3c255c025b Show tags in search results (if activated in ConfigPortal_p.html)
13 years ago
Michael Peter Christen 16d8f33795 added objectlink generation to vocabulary generation and editor
13 years ago
cominch f49d92d8da Cleanup of interaction class and helper routines
13 years ago
cominch 56b0115054 Triplestore: modify routines to access per user store
13 years ago
cominch a95127c9af Triplestore: initalize per-user triplestores
13 years ago
Michael Peter Christen d45718251e refactoring (Localization -> Location)
13 years ago
Michael Peter Christen b8b3c87ba7 - renamed localization to location (that was confusing)
13 years ago
Michael Peter Christen e89747bb67 - added automated generation of vocabularies from url stubs
13 years ago
Michael Peter Christen 79464189a4 The 'Locale' vocabulary, which is generated by geo data, has now the
13 years ago
Michael Peter Christen eca38c53e7 added a vocabulary editor
13 years ago
Michael Peter Christen 61bb52d55c - using http://purl.org/dc/terms/references to refer from an
13 years ago
Michael Peter Christen 2bbb6c52cf added option to clean the triplestore when deleting the index
13 years ago
Michael Peter Christen 50c576599b allow multiple parser options instead of printing an error
13 years ago
Michael Peter Christen c02d742e53 proper namespaces in triplestore dump
13 years ago
Michael Peter Christen 8b53771db2 changed behavior of navigation processing:
13 years ago
Michael Peter Christen 5fc6524ca8 - moved triple store to net.yacy.cora.lod (should be generalized there
13 years ago
cominch 8d2e6355f8 augmented browsing: remove non-existing external snippet file
13 years ago
cominch c90f174799 preparation and generalization of augmented browsing methods
13 years ago
Michael Peter Christen bef823c247 close the reader if finished
13 years ago
Michael Peter Christen 4ee6fb1de9 added missing blacklist dht cache storage (maybe due to mistakes in
13 years ago
Roland 'Quix0r' Haeder e4d36fa5eb Fix to make all values lower-case (this should make all existing blacklists compatible with the new enum)
13 years ago
Roland 'Quix0r' Haeder edaa09b9b1 Rewrote all String blacklist types to enum 'BlacklistType', closes bug
13 years ago
Roland 'Quix0r' Haeder af5a597e47 Scroogle is not comming back, remove dead code
13 years ago
cominch 7a4dab6d1d - removed unused variables
13 years ago
Michael Peter Christen ca93835713 removed usage of deprecated methods
13 years ago
Michael Peter Christen 23e38bd918 do not load the "_triplestore.rdf" files which are of special use in
13 years ago
Michael Peter Christen 90c6fc4b63 load all - but not the persistent local.rdf - triples from
13 years ago
cominch bbfc53b663 bugfix
13 years ago
cominch 65c5826d93 bugfix
13 years ago
cominch aa0295917c augmentation
13 years ago
cominch ed2ea0f08e augmented browsing modification
13 years ago
cominch 6b32f7c1f6 re-enable augmented proxy
13 years ago
cominch 3b08edec2e bugfix
13 years ago
cominch 5f8ba7f4f2 small changes
13 years ago
cominch 300b235ce8 Updated Demo Servlet
13 years ago