Commit Graph

1131 Commits (aa4b04e3dd46b8ad27f865293f4a17d24e769934)

Author SHA1 Message Date
theli 754a35877f *) Changing robots parser cxclusion policy
19 years ago
theli c69f7a39a3 *) adding a startup-test to avoid running into the unzip bug
19 years ago
hermens a2e2d583f9 *) small bugfix regarding peerPingMaxRunning
19 years ago
theli b4e2efef10 *) first test of new iteration function
19 years ago
rramthun a4e90c4b11 Fixed spelling bug.
19 years ago
low012 c45517db46 *) replaced code for table with better version (by kane)
19 years ago
orbiter eabf4a0386 fix for null pointer exception during shut-down
19 years ago
orbiter 47843e69e2 auto-reset for switchboard queue stack
19 years ago
orbiter a70970f993 fixed increment in content iterator
19 years ago
hermens 62ab8d18c1 *) Bugfix for peer sorting method. This seems to cause funny side effects in the SeedDB
19 years ago
hermens 75b268f16d *) use majority voting for peer type decision
19 years ago
allo bc75ea5e12 correcting migration
19 years ago
orbiter d6581c445b added content iterator for corrupted database files
19 years ago
theli ecdc1f7547 *) Bugfix for crawling URLs with query parameters
19 years ago
low012 eb80156233 *) added Kane's code for tables
19 years ago
low012 ef22fa8bf2 *) beautifying code and a little comment
19 years ago
orbiter fc4ae899f7 added word-position to ranking (this is only a first step)
19 years ago
orbiter bb2095fe39 assortment files are now not deleted, but shifted to a backup directory.
19 years ago
orbiter 7366e39dd3 tried to fix 100% CPU bug.
19 years ago
orbiter f14d49fae9 enhancements, bugfixes and additions to word index attribute storage
19 years ago
allo a40acf050e warning if the DBs already exist in WORK
19 years ago
allo 4d33020f56 Migration to WORK
19 years ago
rramthun 1e5feedf0e Fix for http://www.yacy-forum.de/viewtopic.php?p=15547#15547
19 years ago
orbiter f4ffa9aee5 - implemented more attributes to index entries
19 years ago
theli 026dcdfcc0 *) Bugfix from mbirth for ftpc bug
19 years ago
rramthun 34a7802a36 .bat files create DOS-window with title "YaCy" as suggested in http://www.yacy-forum.de/viewtopic.php?p=15470#15470
19 years ago
orbiter 90b940e90e fixed position storage problem.
19 years ago
orbiter 0371494010 tried to add word position to index
19 years ago
orbiter f1cfee7703 removed tabs from condenser
19 years ago
hermens 37791fd529 *) Close indexEntities when "found not enough peers for distribution"
19 years ago
orbiter 3ec7177f0f added seed flag 'AcceptCitationReference'
19 years ago
borg-0300 c5b6154136 added CRDistOn = true/false
19 years ago
low012 ee010c36ae *) fixed bug where ampersands were replaced by replaceHTML even if they were part of &.+;
19 years ago
orbiter 71d5c2b2ca better control for target peer selection for RWI transfer
19 years ago
allo b453199c68 first step for a special migration class.
19 years ago
hermens ca7407b7e1 *) Don't change maxTime if zero or negative
19 years ago
hermens 84fce71d11 *) correct merging of indexes when enumerating downward
19 years ago
low012 7d5af75d11 *) Second try: replaced replaceHTML again. There should be no problem this time.
19 years ago
orbiter d45b1162e2 signature fix
19 years ago
orbiter c51e18c4ad - added signatures to ordering
19 years ago
low012 c6d58d9b9a *) taking back changes for replaceHTML
19 years ago
low012 8af5df7883 *) Replaced replaceHTML by a more versatile method (code by Kane). Please test for possible side effects if you use this method in any of your classes.
19 years ago
allo fd1dd6859b code cleanup
19 years ago
theli 99031b10ae *) Bugfix for recursive translation problem with file separators
19 years ago
allo 1f9ff68f45 bugfix for the notdir in the recursive functions
19 years ago
theli da81d7db17 *) Adding possibility to close open connections via Connections_p.html
19 years ago
hydrox 695dfb7eab *) -rwihashlist can now write to a zip-file
19 years ago
allo 4f8127946e inc Files are now translatable
19 years ago
allo f8ee05372f better Logging
19 years ago
allo 5531d18676 translations with relative Path
19 years ago
allo fe2d983c3e recursive Translations!
19 years ago
orbiter 3d7c8aaeae removed confusing method
19 years ago
orbiter 4cd0c45a77 code cleanup
19 years ago
hermens 971247b78f - rotate merged indexes after merging
19 years ago
(no author) 001513cc1f Now custom httpHeader can be created
19 years ago
(no author) 55f3232219 Patch for the Coockie management.
19 years ago
orbiter e2ff1767b5 fix for last DHT distribution bug-fix
19 years ago
allo 2cd01eb1aa bugfix for dates.db
19 years ago
allo d5aaaf500f bookmarksDB:
19 years ago
orbiter 060e5a0df0 fixed problem with DHT target peer selection:
19 years ago
theli 7c22afe3de *) Bugfix for NullpointerException in deleteOldHTCache
19 years ago
(no author) 873cff20e9 handle UTF-8 correctly
19 years ago
(no author) 1d3249e787 handle UTF-8 correctly
19 years ago
(no author) 76f356315d handle UTF-8 correctly
19 years ago
orbiter b21b9df2d0 added section headlines generation to html parser
19 years ago
rramthun c4487deba9 Minor changes collected over some time.
19 years ago
allo 13c978d3bc only lowercase tags
19 years ago
orbiter de359a9431 patched possible 100% cpu bug.
19 years ago
allo 6822dce57b Using Orbiters function for auth
19 years ago
orbiter 38b19ff56a another bugfix to the correctedNodeIterator
19 years ago
orbiter 45c44ca9c8 bugfix for http://www.yacy-forum.de/viewtopic.php?t=1717
19 years ago
orbiter c137683a5c added patch to correct tree-iterator
19 years ago
orbiter 21fac0b6da small bugfix
19 years ago
orbiter 2028403670 - consolidated different orderings to kelondroNaturalOrder
19 years ago
orbiter 9544c47684 added some UTF-8 handling.
19 years ago
borg-0300 9d8dca750e BUGFIX for my last commit
19 years ago
orbiter 537a819824 extended RWIHashList DHT control method:
19 years ago
borg-0300 5449193167 bugfix for http://www.yacy-forum.de/viewtopic.php?t=1706 (i hope)
19 years ago
borg-0300 2a23f5d419 F..., Sorry, no time, later
19 years ago
borg-0300 3a2d13786e bugfix for http://www.yacy-forum.de/viewtopic.php?t=1706
19 years ago
borg-0300 23a39698a7 last commit removed
19 years ago
borg-0300 3abd843cdb bugfix for http://www.yacy-forum.de/viewtopic.php?t=1706
19 years ago
allo c3284c27f5 this Code is now in passwordAuth
19 years ago
theli 1c7f0789c9 *) Allow crawling of dynamic urls if configured
19 years ago
theli 15b4e16591 *) correcting problems with comments while using the urlRedirector in command mode
19 years ago
theli 94e54c4450 *) Removing url hash from loaded list before inserting the url into the crawling queue
19 years ago
theli 99861ff2c1 *) Crawling depth can now be configured via command string in urlRedirector mode
19 years ago
orbiter a125fee9ce fixed iterator
19 years ago
orbiter 33f8920e1c new database format: splitted trees, using an ordering to split the tree
19 years ago
orbiter d83cc3084a fixed small problem when password cannot be decrypted with base64
19 years ago
borg-0300 dc0999ec9c adapted to new HTCache structure
19 years ago
allo 6df8080cf2 tiny fix for recursive Translations
19 years ago
allo 4e4bd4662d redirectors fix
19 years ago
hydrox 8b6d31763d *)added function to create a list of all RWI hashs
19 years ago
allo b63bcf25d7 moving string2vector and vector2string to listsmanager
19 years ago
orbiter 10a095d6b5 - added base64 ordering methods
19 years ago
orbiter 9086261476 refactoring of base64 encoding:
19 years ago
orbiter 7c0d7ed4f8 introduction of generic order interface for kelondro
19 years ago
borg-0300 b24fcc8ca4 oom
19 years ago
borg-0300 7da232b5b9 HTCache Reset if necessary
19 years ago
borg-0300 4f18f24d81 small change
19 years ago
borg-0300 c652527620 YaCy removes now the old HTCACHE data
19 years ago
borg-0300 69f65210e2 ".yacy" has its own directory;
19 years ago
allo 351fffc129 DATA/WORK for user-created content
19 years ago
allo a81cc9d969 no DATA/DATA to avoid confusion.
19 years ago
allo ba96cefe0c packages for xml/*
19 years ago
borg-0300 b95c5d5781 BUGFIX for URLs how "/../" ...;
19 years ago
allo 9cce3c5709 dates Table for bookmarksdb(needed for del.icio.us api)
19 years ago
hermens 11fe95832e avoid division by zero when index transfer is extremely fast
19 years ago
allo 2e2fa99501 bookmarksManager:
19 years ago
allo ca3a513aee del.icio.us style api
19 years ago
allo 75b9163242 xmlapi for bookmarktags
19 years ago
borg-0300 c7abd60782 last commit removed
19 years ago
borg-0300 8eb4181737 BUGFIX for regular expression
19 years ago
borg-0300 106cd29981 regular expression shortened
19 years ago
borg-0300 51433a121f added regular expression for '//';
19 years ago
allo 4c824cacba Description Field
19 years ago
allo 867573de71 rebuildTags to rebuild the tags.db from the bookmarks.db
19 years ago
allo 2982715a04 fix for Nullpointer Exception when adding a bookmark
19 years ago
allo 09c95544c0 edit Function
19 years ago
allo 0619051c4b timestamps
19 years ago
allo d5e27009b1 bookmarks:
19 years ago
allo 87ea300d71 bookmarks interface
19 years ago
allo d0d1855520 tagView
19 years ago
allo ece2844385 bookmarkManager
19 years ago
allo 4ac0fd328a First Version of the Bookmarksmanager
19 years ago
theli d7b6dcbe2e *) Bugfix for MalformedURL problem if Location header is empty.
19 years ago
allo 28f890ee3e Important SECURITY FIX!
19 years ago
allo 0f1212feb9 userDB.hasAdminrights to check adminRights.
19 years ago
orbiter b3dca06bb1 added location column to network pages.
19 years ago
hermens 5b3e01bd3c avoid division by zero when importing very small indexes (<100 entries)
19 years ago
rramthun d0c2c67f4c Update YaWoStat version.
19 years ago
orbiter 60fc34d9e8 iterartion bug:
19 years ago
low012 6c91921e9b *) yacyWiki: more versatile distinction between real external links/links that point to DATA/HTDOC
19 years ago
borg-0300 b7f9adc2c9 new filters added
19 years ago
hydrox 9b617bcb65 *)compression of -domlist now optional (-format zip
19 years ago
hydrox 2bd4a66133 *)-domlist now creates a zipped txt-file.
19 years ago
rramthun 45ebe477ee Bugfix for http://www.yacy-forum.de/viewtopic.php?p=14175
19 years ago
low012 eb0f511767 *) yacyWiki: easy way to link to files on local peers (external links)
19 years ago
theli 79667a172e *) Bugfix for additional parser problem
19 years ago
theli b6be828d15 *) Bugfix: Share subdirectory couldn't be views because of LinkageErrors
19 years ago
orbiter c4dd39e8f2 fixing/changing wiki image inline code
19 years ago
low012 80b3e85356 *) yacyWiki: Images in a share on the same peer can be addressed by path and name only, no complete URL needed anymore. (As requested by theli in http://www.yacy-forum.de/viewtopic.php?t=809)
19 years ago
theli 8c594841a8 *) Bugfix for incorrectly indexing of URLs that were requested with Cookies in the
19 years ago
orbiter b5d02d649a fixed bug caused strange search result behaviour
19 years ago
orbiter 4500506735 fixed some bugs concerning url entry retrieval and intexControl interface
19 years ago
orbiter 83a34b838d * added Object allocation monitor on performanceMemory page
19 years ago
orbiter 4ff3d219e8 increased delay for cacheScan start and slowed down scan process
19 years ago
orbiter 3031903d50 re-design of RAM cache flush into assortment cluster
19 years ago
orbiter 676e384b45 changed synchronization to fix 'contains loops' bug in kelondroTree
19 years ago
orbiter 3cc02fe749 enhanced buffered write by combination of several chunks into one chunk
19 years ago
orbiter 0c762daf4b better startup failure handling
19 years ago
orbiter f27f9ecf15 * activated write buffer for databases.
19 years ago
orbiter c59d1b2f5e - Tests with write buffer (new class kelondroBufferedIOChunks, not yet active)
19 years ago
orbiter ca7e60279d introduced IOChunks.
19 years ago
orbiter bb79fb5d91 - changed handling of error cases retrieving urls from database
19 years ago
orbiter fed92d364b introduced USAGE object for counter synchronization in kelondroRecords
19 years ago
hermens 35cf6712b2 *) fixes for httpd
19 years ago
theli 5a627a690f *) Extending hydrox urlDbCleanup function
19 years ago
theli e7d16ef831 *) Corrections in jMimeMagic MagicRule-file to detect some special rss feeds
19 years ago
orbiter 3086e38bb1 added getRemoved method on demand from theli for migration purpose
19 years ago
theli 386d9e45d8 *) Bugfix for code cleanup
19 years ago
orbiter 356231b033 changed only for testing with new hastable implementation.
19 years ago
theli 5a1d45715d *) Bugfix for parser configuration bug
19 years ago
orbiter 1041f4946a experiments with locks to remove synchronization
19 years ago
orbiter 288b2c353e debugging of kelondroRecords ... possibly synchronization bugs found
19 years ago
rramthun a1061495d4 Fixed some spelling mistakes and added some text which (should) make it easier to understand the options.
19 years ago
orbiter 0cdc58aaea fixed indexing of local domains.
19 years ago
orbiter 76b97e4d2a integrated geo-snap DBStressTest.java in dbtest
19 years ago
hermens ec1202edbe *) Fixes for httpd
19 years ago
theli e1c2d8ec5f *) Speedup "removed from queue"
19 years ago
hydrox 96930f0d2b *)added function to removed malformed URLs from urlHash.db
19 years ago
orbiter d007d14905 re-insert of migrateSwitchConfigSettings
19 years ago
theli 8862b6ba4b *) Corrections for code cleanup 1175
19 years ago
orbiter 0e88ba997e * added option to generate url-lists as plain text file or in html
19 years ago
orbiter 13fdebc50d added authentication for link deletion in search result
19 years ago
orbiter 37f88b4017 code cleanup
19 years ago
orbiter ec2b39c1ce code cleanup
19 years ago
orbiter 76618442e0 code cleanup
19 years ago
orbiter 8f1f2daa5e implemented interactive link deletion of search results.
19 years ago
theli 6d0f7e6988 *) Adding missing file
19 years ago
theli 44fa94ac52 *) Modifications for dbImport functionality
19 years ago
orbiter 28ddba8813 added vote-button images
19 years ago
orbiter dc778659fb fixed problem with time-out during result joint which caused OR behavior instead of AND beahvior
19 years ago
orbiter 3d8a5ae652 code cleanup
19 years ago
allo ae6a4650bc reenabling debugMode (60 Seconds timeout for *all* http connections)
19 years ago
theli bb1f73ec15 *) Bugfix for code cleanup
19 years ago
orbiter 7920e1547d code cleanup
19 years ago
theli 972b8ddd2a *) minor changes: using constants properly
19 years ago
theli 1c3750de57 *) Bugfix for code cleanup
19 years ago
theli 64478b1f02 *) Adding possibility to delete crawler queue entries using regular expressions
19 years ago
orbiter 1d6a6d1f85 code cleanup
19 years ago
orbiter a04930f025 code cleanup
19 years ago
low012 90b0eb144e just a typo...
19 years ago
theli 129b15f3e1 *) Correcting logging output of db importer thread
19 years ago
theli 7028412c54 *) Bugfix for NullpointerException in Java Finalizer
19 years ago
orbiter 420d56ce79 extended db-testing
19 years ago
orbiter ecf765ec33 temporary fix to make jrpm extension compilable with my netbeans environment
19 years ago
rramthun 8c0d982191 1.) Fix from Martin (he ist not at home...)
19 years ago
theli b604654c25 *) Adding possibility to do a settings migration on yacy startup
19 years ago