You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler/retrieval
orbiter d2fd93135c
- moved yacybot user agent string definition to MultiProtocolURI since there are basic access mechanisms where the bot string is needed
15 years ago
..
EventOrigin.java - added function to OAI-PMH reader that can pull all records from a server using an evaluation of the resumption token to get URL to retrieve remaining records 16 years ago
FTPLoader.java redesign of crawl profiles data structure. target will be: 15 years ago
FileLoader.java fixes for crawling of smb links (file length not always available) 15 years ago
HTTPLoader.java - moved yacybot user agent string definition to MultiProtocolURI since there are basic access mechanisms where the bot string is needed 15 years ago
Request.java This is a large bugfix and enhancement commit to support a better location detection for data 15 years ago
Response.java redesign of crawl profiles data structure. target will be: 15 years ago
SMBLoader.java fixes for crawling of smb links (file length not always available) 15 years ago