Commit Graph

61 Commits (8043bb82fbebc891e96d5ea051ae27b35ce4ab4a)

Author SHA1 Message Date
orbiter ceb9e3aa17 - enhanced parser: collection of audio, video, image and application links
18 years ago
orbiter b5a29e9651 - fix for snippets that are too short
18 years ago
orbiter 30888e7a2f implementation of search constraints
18 years ago
orbiter d34f10c63d some tests with reverse dns lookup
18 years ago
orbiter 497428c8ec refactoring
18 years ago
allo a75f895884 memory and traffic informations
18 years ago
allo 2ba56f70a8 XML-safe put.
18 years ago
allo a17c43779f removed wrong part of template
18 years ago
allo 27f9e0b1c6 xml interface for blacklists
18 years ago
allo 74f09a0510 some more xml-backend files.
18 years ago
allo e25172853a fixed license notice
18 years ago
allo 1d0c0edda3 first version of posts/get from the del.icio.us api
18 years ago
orbiter 5a40ea7866 refactoring of wget string list generation
18 years ago
orbiter dbc2e039bb added time-out option parameter to call hierarchy
18 years ago
orbiter b59d4576af increased version number to emphasise that the snippet fix
18 years ago
orbiter d4c239e4be - fixed problem in collection index with deletion of single url references
18 years ago
orbiter df1629b05a - code cleanup
18 years ago
orbiter 3aac5b26da - added automatic tag generation when a web page from the search results is added
18 years ago
orbiter 5015e780c2 - simplified watchCrawler code
18 years ago
orbiter c89d8142bb replaced old 'kCache' by a full-controlled cache
18 years ago
theli 92e986bb91 *) adding missing return prop (requested by allo)
18 years ago
allo f0529fe53e update for ftp urls
18 years ago
theli 413e6b9855 *) direct access to responseheaders of sbQueue.Entry removed to make it more http independent
18 years ago
theli eb9b138986 *) next step of restructuring for new crawlers
18 years ago
theli 1395aae742 *) starting restructuring which is needed to add crawlers for additional protocols
18 years ago
orbiter 7df572756a fist step+attempt so solve the snippet marking problem.
18 years ago
orbiter 3879a0ecd0 replaced java.net.URL usage by use of new class de.anomic.net.URL
19 years ago
allo 933a9e02ab fix for broken build
19 years ago
allo 360056b30c fix ajax bug (no valid xml)
19 years ago
orbiter 90d569d70f refactoring of index management:
19 years ago
allo 44d72f06c4 more Caching
19 years ago
allo 1a13c8b78e right wordCachesize after orbiters commit.
19 years ago
allo 6b056610e3 updated watchcrawler for the recent changes
19 years ago
orbiter bcd99fe83e introduced a second RAM cache for DHT transfer
19 years ago
orbiter bae3783d38 added a snippet marking
19 years ago
allo fb5d8fdc59 removed encoding attribute
19 years ago
allo f1b91b1266 xml with right encoding
19 years ago
orbiter 3703f76866 - fixed re-search bug: after a search with several words, a second search could not
19 years ago
theli dc9174c809 *) Implementing snippet fetching via ajax
19 years ago
allo 7e7a72b108 display wordcaches number on WatchCrawler.html
19 years ago
allo 3fd1641893 queuesizes in queues_p.xml
19 years ago
allo 62664d7252 AJAX Check for robots.txt before crawling.
19 years ago
allo 26d7e8dd0d more escapes
19 years ago
allo 127396436f more queues in the xml backend
19 years ago
allo 99a970eda1 xml backend with verifyAuthentication
19 years ago
allo 73f18ed5b2 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1627 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo a4513523d6 hide add/edit/import bookmarks per default.
19 years ago
allo 27b6b3d714 public Tags.
19 years ago
allo a8eff9a0ae xml/bookmarks/posts/all.xml to list all public Bookmarks
19 years ago
allo 62a0bb475a More values displayed on WatchCrawler.html
19 years ago