Commit Graph

12 Commits (358feeeb391e0452a90fc488a16e71763deeec99)

Author SHA1 Message Date
orbiter a563b05b60 enhanced crawler:
14 years ago
orbiter 091dd3f6ec - enhanced intranet search speed
15 years ago
orbiter 48c0d508ac fixes for crawling of smb links (file length not always available)
15 years ago
orbiter 65eaf30f77 redesign of crawl profiles data structure. target will be:
15 years ago
orbiter 3197ca42ed preparations to move the HTCache into cora:
15 years ago
orbiter 5e7081cd19 refactoring towards a unified loading mechanism for MultiProtocolURIs
15 years ago
orbiter 90531f78ff refactoring of the cora package to get subpackages for http and ftp (smb to come)
15 years ago
orbiter a82a93f2fc - better url double check in crawler
15 years ago
orbiter 6950d8a33d fixes to SMB crawler
15 years ago
orbiter 25aef069a6 continuing String-hash - to - byte[]-hash redesign that was started in SVN 6775
15 years ago
orbiter 3300930fc5 - (almost) fixed FTP crawler
15 years ago
orbiter 9623d9e6d2 added a smb loader component for the YaCy crawler
15 years ago