You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/de/anomic/crawler/retrieval
orbiter 2126c03a62
- removed download-limit that can be given for the crawler for non-crawler download tasks. This was necessary because the same procedure was used for other downloads like for the download of dictionary files where a limit is not useful. The limit still stays for the indexer
15 years ago
..
EventOrigin.java - added function to OAI-PMH reader that can pull all records from a server using an evaluation of the resumption token to get URL to retrieve remaining records 15 years ago
FTPLoader.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 15 years ago
HTTPLoader.java - removed download-limit that can be given for the crawler for non-crawler download tasks. This was necessary because the same procedure was used for other downloads like for the download of dictionary files where a limit is not useful. The limit still stays for the indexer 15 years ago
Request.java This is a large bugfix and enhancement commit to support a better location detection for data 15 years ago
Response.java fixed dates in metadata 15 years ago
SMBLoader.java continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775 15 years ago