You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
orbiter
89b9b2b02a
redesigned remote crawl process:
...
- instead of pushing urls to other peers, the urls are actively pulled
by the peer that wants to do a remote crawl
- the remote crawl push process had been removed
- a process that adds urls from remote peers had been added
- the server-side interface for providing 'limit'-urls exists since 0.55 and works with this version
- the list-interface had been removed
- servlets using the list-interface had been removed (this implementation did not properly manage double-check)
- changes in configuration file to support new pull-process
- fixed a bug in crawl balancer (status was not saved/closed properly)
- the yacy/urls-protocol was extended to support different networks/clusters
- many interface-adoptions to new stack counters
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4232 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
..
cache
preparations for mass remote crawls:
18 years ago
crawler
redesigned remote crawl process:
18 years ago
dbImport
- enhanced monitoring of ranking parameters
18 years ago
parser
Add another external dependency from PDFBox package ("Bouncy Castle"). This is necessary for parsing of some encrypted PDF files.
18 years ago
urlPattern
clear caches after changing blacklists, closes http://forum.yacy-websuche.de/viewtopic.php?f=6&t=241&p=1964#p1964
18 years ago
plasmaCondenser.java
preparations for better ranking: better debugging of index properties
18 years ago
plasmaCrawlBalancer.java
redesigned remote crawl process:
18 years ago
plasmaCrawlEURL.java
fixed problem with redirection: redirected URLs had not been tested with the double-check
18 years ago
plasmaCrawlEntry.java
fixed image search and favicon loading
18 years ago
plasmaCrawlLURL.java
- fixed bad behaviour of search event worker processes
18 years ago
plasmaCrawlLoaderMessage.java
joined anomic.net.URL, plasmaURL and url hash computation:
18 years ago
plasmaCrawlNURL.java
- redesigned crawl start menu, integrated monitoring pages
18 years ago
plasmaCrawlProfile.java
- redesigned crawl start menu, integrated monitoring pages
18 years ago
plasmaCrawlRobotsTxt.java
*) robots.txt: adding support for crawl-delay
18 years ago
plasmaCrawlStacker.java
- enhanced monitoring of ranking parameters
18 years ago
plasmaCrawlZURL.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaDHTChunk.java
- enhanced monitoring of ranking parameters
18 years ago
plasmaDHTFlush.java
some bugfixes:
18 years ago
plasmaDHTTransfer.java
fix for peer ping problem (implemented a 3-time re-ping); cause for 'Connection reset' still unknown
18 years ago
plasmaGrafics.java
*) fixed bug where dots were added after numbers < 1000: "123" was transformed to "123." which is undesirable
18 years ago
plasmaHTCache.java
preparations for mass remote crawls:
18 years ago
plasmaParser.java
fixed image search and favicon loading
18 years ago
plasmaParserConfig.java
fixed image search and favicon loading
18 years ago
plasmaParserDocument.java
joined anomic.net.URL, plasmaURL and url hash computation:
18 years ago
plasmaRankingCRProcess.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaRankingDistribution.java
transferRanking(): Do not flush more ranking files than requested by caller.
18 years ago
plasmaRankingRCIEvaluation.java
enhanced local search speed. The ranking process is now 6 times faster that before.
18 years ago
plasmaSearchEvent.java
NPE fix, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=549&hilit=&p=3383#p3383
18 years ago
plasmaSearchImages.java
joined anomic.net.URL, plasmaURL and url hash computation:
18 years ago
plasmaSearchQuery.java
- enhanced monitoring of ranking parameters
18 years ago
plasmaSearchRankingProcess.java
fix for NPE, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=549&hilit=&p=3368#p3368
18 years ago
plasmaSearchRankingProfile.java
redesign of ranking data structure
18 years ago
plasmaSnippetCache.java
removed parser object pool, see also svn 4106
18 years ago
plasmaStore.java
code cleanup
20 years ago
plasmaSwitchboard.java
redesigned remote crawl process:
18 years ago
plasmaSwitchboardQueue.java
- enhanced monitoring of ranking parameters
18 years ago
plasmaWebStructure.java
joined anomic.net.URL, plasmaURL and url hash computation:
18 years ago
plasmaWordConnotation.java
- added SSI parser and include directive for <!--# include virtual="<file>" -->
18 years ago
plasmaWordIndex.java
redesign of ranking data structure
18 years ago