You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
orbiter
ecba35de72
enhanced computing speed of kelondro core function: sorting
...
the enhancement was made by using better organized data structures and
multi-threading during the sort. A sort can be divided into two separate
processes when the first partition of the quicksort algorithm was done.
Generating a separate thread and starting the thread takes only 10 milliseconds,
so using a separate thread makes only sense if the data amount is large.
statistics about the speed-up:
without ehancement: 250 milliseconds for 100000 entries
with data structure enhancement: 170 milliseconds for 100000 entries
with additional second thread (if second processor is present): 130 milliseconds.
For dual-processor systems, this means about 100% speed-up
a test can be made with the following command:
java -classpath classes de.anomic.kelondro.kelondroRowCollection
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4198 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
..
cache
preparations for mass remote crawls:
18 years ago
crawler
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
dbImport
preparations for mass remote crawls:
18 years ago
parser
Add external lib FontBox which is part of the PDFBox (they extracted the font handling code into this package in 0.7.3).
18 years ago
urlPattern
clear caches after changing blacklists, closes http://forum.yacy-websuche.de/viewtopic.php?f=6&t=241&p=1964#p1964
18 years ago
plasmaCondenser.java
- Changed yFormatter handling to be more flexible and produce more readable code for server pages. There are serverObject.putNum() methods to allow adding of number type values in a formatted form, and put() methods for number types that add them without formatting. This reduces the need to transform them into Strings in server pages and removes the HTML encoding step which is unecessary for numbers.
18 years ago
plasmaCrawlBalancer.java
distinct keepOrder strategy, more discrete implementation of enhancement introduced in SVN 4158
18 years ago
plasmaCrawlEURL.java
fixed problem with redirection: redirected URLs had not been tested with the double-check
18 years ago
plasmaCrawlEntry.java
preparations for mass remote crawls:
18 years ago
plasmaCrawlLURL.java
distinct keepOrder strategy, more discrete implementation of enhancement introduced in SVN 4158
18 years ago
plasmaCrawlLoaderMessage.java
joined anomic.net.URL, plasmaURL and url hash computation:
18 years ago
plasmaCrawlNURL.java
- redesigned crawl start menu, integrated monitoring pages
18 years ago
plasmaCrawlProfile.java
- redesigned crawl start menu, integrated monitoring pages
18 years ago
plasmaCrawlRobotsTxt.java
*) robots.txt: adding support for crawl-delay
18 years ago
plasmaCrawlStacker.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaCrawlZURL.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaDHTChunk.java
re-designed some parts of DHT position calculation (effect is the same as before)
18 years ago
plasmaDHTFlush.java
some bugfixes:
18 years ago
plasmaDHTTransfer.java
fix for peer ping problem (implemented a 3-time re-ping); cause for 'Connection reset' still unknown
18 years ago
plasmaGrafics.java
some additions and a small bugfix to SVN 4158
18 years ago
plasmaHTCache.java
preparations for mass remote crawls:
18 years ago
plasmaParser.java
removed parser object pool, see also svn 4106
18 years ago
plasmaParserConfig.java
removed parser object pool, see also svn 4106
18 years ago
plasmaParserDocument.java
joined anomic.net.URL, plasmaURL and url hash computation:
18 years ago
plasmaRankingCRProcess.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaRankingDistribution.java
transferRanking(): Do not flush more ranking files than requested by caller.
18 years ago
plasmaRankingRCIEvaluation.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaSearchEvent.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaSearchImages.java
joined anomic.net.URL, plasmaURL and url hash computation:
18 years ago
plasmaSearchProcessing.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaSearchQuery.java
steps to enhance remote search performance:
18 years ago
plasmaSearchRankingProcess.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaSearchRankingProfile.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaSnippetCache.java
removed parser object pool, see also svn 4106
18 years ago
plasmaStore.java
code cleanup
20 years ago
plasmaSwitchboard.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaSwitchboardQueue.java
preparations for mass remote crawls:
18 years ago
plasmaWebStructure.java
joined anomic.net.URL, plasmaURL and url hash computation:
18 years ago
plasmaWordConnotation.java
- added SSI parser and include directive for <!--# include virtual="<file>" -->
18 years ago
plasmaWordIndex.java
enhanced computing speed of kelondro core function: sorting
18 years ago