Commit Graph

9571 Commits (b85db72a73da4797d09dc72155c56ca00dd5da0f)
 

Author SHA1 Message Date
Michael Peter Christen 6905182d41 - fix for number of words log message
12 years ago
Michael Peter Christen c25d7bcb80 - added concurrency for robots.txt loading
12 years ago
Michael Peter Christen a94c537afc fixed getSize() which can use the cache size while the crawl is running
12 years ago
Michael Peter Christen 96912c9471 enhancement to solr caching: consider that during a get() the document
12 years ago
Michael Peter Christen a87811bc38 more auto-commit calls when a search interface is opened, but not when a
12 years ago
Michael Peter Christen 3d3d654e88 if a network configuration is choosed which does not allow DHT and no
12 years ago
Michael Peter Christen 2d9e577ad0 replaced the custom robots.txt loader by the standard http loader
12 years ago
Michael Peter Christen 799d71bc67 enhanced solr caching:
12 years ago
Michael Peter Christen a33e2742cb - removed unnecessary synchronized and deadlock in crawler
12 years ago
orbiter 8952153ecf update to Balancer algorithm:
12 years ago
orbiter 354f0d9acd moved static method from ClusteredScoreMap to MapDataMining because it
12 years ago
reger 722a447b0d - optimize code of augmented parsing to enhence document tags
12 years ago
Michael Peter Christen 8e1248ffe3 force a commit in advance of a search for the administrator to get most
12 years ago
Michael Peter Christen 3b48c78190 added an option to force a commit to solr.
12 years ago
sixcooler 2d972f289a rise commitWithinMs to default-value from SwitchBoard
12 years ago
orbiter 8fde1dd3b6 another performance and memory hack to graphics: this makes it possible
12 years ago
Michael Peter Christen 1baf498d59 - show more lines in online log
12 years ago
Michael Peter Christen 55bdafbaf1 more image processing hacks
12 years ago
Michael Peter Christen f2d0418218 because the new PngEncoder had a problem with the PixelGrabber which is
12 years ago
Michael Peter Christen d5d64019e5 - added a method for the RasterPlotter to draw arrow endings to lines
12 years ago
Michael Peter Christen 342543a6c4 fix for host browser
12 years ago
Michael Peter Christen 85ca07b90e when a new crawl is started, an equal crawl, if still running, is
12 years ago
Michael Peter Christen 906e51214a the web structure image shows the pivot dot in a different color
12 years ago
Michael Peter Christen b3ffcde0c7 - prepared PngEncoder for concurrency: PixelGrabber.grabPixels is the
12 years ago
Michael Peter Christen e9c6f4ce2e - new order of data computation: first compute the size of
12 years ago
orbiter c6a1b21399 added a 9-year old png encoder from David Eisenberg which I rewrote
12 years ago
orbiter 276dd6452b removed warnings
12 years ago
orbiter 59bf4677b6 added option to view the complete directory structure in host browser
12 years ago
Michael Peter Christen b991685782 Merge branch 'master' of git://gitorious.org/~reger/yacy/bbyacy-rc1
12 years ago
Michael Peter Christen 7602fce0b9 Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
12 years ago
Michael Peter Christen ea11a1efea fix for highlighting in gsa search
12 years ago
Michael Peter Christen 9eaede50e7 enhanced web structure images
12 years ago
Michael Peter Christen b7ac1da6a3 gsa results shall have only one title in metadata and that should be the
12 years ago
sixcooler 206e7bcf94 whitelist yacyportalsearch aka search.yacy.net
12 years ago
Michael Peter Christen ae6feb5610 showing the web structure graph as animation in the crawl monitor
12 years ago
reger 87aab9aa7c - fix: with augmented parsing = on; missing metadata in index (like title) due to overwriting metadata by adding multiple result docs from augmentparser with same url
12 years ago
Michael Peter Christen 39317a6c66 enhanced webstructure image: introduced
12 years ago
sixcooler 47ae7e322e smaller dhtDispatcher.cloudSize
12 years ago
sixcooler 57ddd63888 not hold a expensive cache of references for DHT-out,but but load them
12 years ago
reger 1dc6482feb format crawler timeout output string in seconds (was days)
12 years ago
Michael Peter Christen ef937af35d more custom field usage in gsa search result
12 years ago
Michael Peter Christen ea27d2e5f6 fixed more getSolrFieldName usages
12 years ago
Michael Peter Christen ce0e5b1e17 - more refactoring / private methods
12 years ago
Michael Peter Christen ccc3760a47 Refactoring and redesign of data architecture to make URIMetadataRow
12 years ago
Michael Peter Christen 7f71dfab03 added a HostBrowser.xml api file and changed a bit of attribute naming
12 years ago
Michael Peter Christen b400fc7b4d fix for file parser problem
12 years ago
Michael Peter Christen e5b3c172ff removed hack which translated Solr documents to virtual RWI entries
12 years ago
Michael Peter Christen 6017691522 added an exception catch
12 years ago
Michael Peter Christen 68c7ed5ce9 added a shell script which can be used to delete the api action steering
12 years ago
Michael Peter Christen ed803708ab added a shell script which can be used to add a rss feed to the index.
12 years ago