You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 8df8ffbb6d enhanced the snapshot functionality: ... - snapshots can now also be xml files which are extracted from the solr index and stored as individual xml files in the snapshot directory along the pdf and jpg images - a transaction layer was placed above of the snapshot directory to distinguish snapshots into 'inventory' and 'archive'. This may be used to do transactions of index fragments using archived solr search results between peers. This is currently unfinished, we need a protocol to move snapshots from inventory to archive - the SNAPSHOT directory was renamed to snapshot and contains now two snapshot subdirectories: inventory and archive - snapshots may now be generated by everyone, not only such peers running on a server with xkhtml2pdf installed. The expert crawl starts provides the option for snapshots to everyone. PDF snapshots are now optional and the option is only shown if xkhtml2pdf is installed. - the snapshot api now provides the request for historised xml files, i.e. call: http://localhost:8090/api/snapshot.xml?urlhash=Q3dQopFh1hyQ The result of such xml files is identical with solr search results with only one hit. The pdf generation has been moved from the http loading process to the solr document storage process. This may slow down the process a lot and a different version of the process may be needed.		10 years ago
..
Cache.java	more IPv6 bugfixes	11 years ago
CrawlProfile.java	enhanced the snapshot functionality:	10 years ago
CrawlQueues.java	ViewFile servlet: update index if newer,	11 years ago
Latency.java	- added a new Crawler Balancer: HostBalancer and HostQueues:	11 years ago
NoticedURL.java	reduce number of calls to queue.size() because that may be a bottleneck	11 years ago
ResultImages.java	fix for image alt attachment to AnchorURLs in html parser.	11 years ago
ResultURLs.java	migrated the index export methods from the old metadata to solr. Now	12 years ago
Snapshots.java	enhanced the snapshot functionality:	10 years ago
Transactions.java	enhanced the snapshot functionality:	10 years ago