You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler
orbiter 56264dcc17
- added CamelCase parser to MultiProtocolURI: generate better to-be-indexed words from urls
14 years ago
..
retrieval - added CamelCase parser to MultiProtocolURI: generate better to-be-indexed words from urls 14 years ago
Balancer.java fixed crawl queue delete function 14 years ago
CrawlProfile.java custom + generic skins: 14 years ago
CrawlQueues.java enhanced crawler: 14 years ago
CrawlStacker.java - added CamelCase parser to MultiProtocolURI: generate better to-be-indexed words from urls 14 years ago
CrawlSwitchboard.java fixed a number of small bugs: 14 years ago
ImporterException.java
Latency.java preparations to move the HTCache into cora: 14 years ago
NoticedURL.java enhanced crawler: 14 years ago
RSSLoader.java fix for scheduling of rss feeds 14 years ago
ResourceObserver.java change in handling of the all-visible home path for storage in YaCy: 14 years ago
ResultImages.java
ResultURLs.java - added a tag cloud to search results (using the topics) 14 years ago
RobotsEntry.java - replaced pdfbox and fontbox version 1.1.0 with 1.2.1 14 years ago
RobotsTxt.java - moved yacybot user agent string definition to MultiProtocolURI since there are basic access mechanisms where the bot string is needed 14 years ago
SitemapImporter.java enhanced crawler: 14 years ago
ZURL.java
robotsParser.java added a sitemap entry parser and loader for sitemaps 14 years ago