Commit Graph

1080 Commits (08aea2597d99f1c90048d234eacef29717e5906c)

Author SHA1 Message Date
borg-0300 c652527620 YaCy removes now the old HTCACHE data
19 years ago
borg-0300 69f65210e2 ".yacy" has its own directory;
19 years ago
allo 351fffc129 DATA/WORK for user-created content
19 years ago
allo a81cc9d969 no DATA/DATA to avoid confusion.
19 years ago
allo ba96cefe0c packages for xml/*
19 years ago
borg-0300 b95c5d5781 BUGFIX for URLs how "/../" ...;
19 years ago
allo 9cce3c5709 dates Table for bookmarksdb(needed for del.icio.us api)
19 years ago
hermens 11fe95832e avoid division by zero when index transfer is extremely fast
19 years ago
allo 2e2fa99501 bookmarksManager:
19 years ago
allo ca3a513aee del.icio.us style api
19 years ago
allo 75b9163242 xmlapi for bookmarktags
19 years ago
borg-0300 c7abd60782 last commit removed
19 years ago
borg-0300 8eb4181737 BUGFIX for regular expression
19 years ago
borg-0300 106cd29981 regular expression shortened
19 years ago
borg-0300 51433a121f added regular expression for '//';
19 years ago
allo 4c824cacba Description Field
19 years ago
allo 867573de71 rebuildTags to rebuild the tags.db from the bookmarks.db
19 years ago
allo 2982715a04 fix for Nullpointer Exception when adding a bookmark
19 years ago
allo 09c95544c0 edit Function
19 years ago
allo 0619051c4b timestamps
19 years ago
allo d5e27009b1 bookmarks:
19 years ago
allo 87ea300d71 bookmarks interface
19 years ago
allo d0d1855520 tagView
19 years ago
allo ece2844385 bookmarkManager
19 years ago
allo 4ac0fd328a First Version of the Bookmarksmanager
19 years ago
theli d7b6dcbe2e *) Bugfix for MalformedURL problem if Location header is empty.
19 years ago
allo 28f890ee3e Important SECURITY FIX!
19 years ago
allo 0f1212feb9 userDB.hasAdminrights to check adminRights.
19 years ago
orbiter b3dca06bb1 added location column to network pages.
19 years ago
hermens 5b3e01bd3c avoid division by zero when importing very small indexes (<100 entries)
19 years ago
rramthun d0c2c67f4c Update YaWoStat version.
19 years ago
orbiter 60fc34d9e8 iterartion bug:
19 years ago
low012 6c91921e9b *) yacyWiki: more versatile distinction between real external links/links that point to DATA/HTDOC
19 years ago
borg-0300 b7f9adc2c9 new filters added
19 years ago
hydrox 9b617bcb65 *)compression of -domlist now optional (-format zip
19 years ago
hydrox 2bd4a66133 *)-domlist now creates a zipped txt-file.
19 years ago
rramthun 45ebe477ee Bugfix for http://www.yacy-forum.de/viewtopic.php?p=14175
19 years ago
low012 eb0f511767 *) yacyWiki: easy way to link to files on local peers (external links)
19 years ago
theli 79667a172e *) Bugfix for additional parser problem
19 years ago
theli b6be828d15 *) Bugfix: Share subdirectory couldn't be views because of LinkageErrors
19 years ago
orbiter c4dd39e8f2 fixing/changing wiki image inline code
19 years ago
low012 80b3e85356 *) yacyWiki: Images in a share on the same peer can be addressed by path and name only, no complete URL needed anymore. (As requested by theli in http://www.yacy-forum.de/viewtopic.php?t=809)
19 years ago
theli 8c594841a8 *) Bugfix for incorrectly indexing of URLs that were requested with Cookies in the
19 years ago
orbiter b5d02d649a fixed bug caused strange search result behaviour
19 years ago
orbiter 4500506735 fixed some bugs concerning url entry retrieval and intexControl interface
19 years ago
orbiter 83a34b838d * added Object allocation monitor on performanceMemory page
19 years ago
orbiter 4ff3d219e8 increased delay for cacheScan start and slowed down scan process
19 years ago
orbiter 3031903d50 re-design of RAM cache flush into assortment cluster
19 years ago
orbiter 676e384b45 changed synchronization to fix 'contains loops' bug in kelondroTree
19 years ago
orbiter 3cc02fe749 enhanced buffered write by combination of several chunks into one chunk
19 years ago
orbiter 0c762daf4b better startup failure handling
19 years ago
orbiter f27f9ecf15 * activated write buffer for databases.
19 years ago
orbiter c59d1b2f5e - Tests with write buffer (new class kelondroBufferedIOChunks, not yet active)
19 years ago
orbiter ca7e60279d introduced IOChunks.
19 years ago
orbiter bb79fb5d91 - changed handling of error cases retrieving urls from database
19 years ago
orbiter fed92d364b introduced USAGE object for counter synchronization in kelondroRecords
19 years ago
hermens 35cf6712b2 *) fixes for httpd
19 years ago
theli 5a627a690f *) Extending hydrox urlDbCleanup function
19 years ago
theli e7d16ef831 *) Corrections in jMimeMagic MagicRule-file to detect some special rss feeds
19 years ago
orbiter 3086e38bb1 added getRemoved method on demand from theli for migration purpose
19 years ago
theli 386d9e45d8 *) Bugfix for code cleanup
19 years ago
orbiter 356231b033 changed only for testing with new hastable implementation.
19 years ago
theli 5a1d45715d *) Bugfix for parser configuration bug
19 years ago
orbiter 1041f4946a experiments with locks to remove synchronization
19 years ago
orbiter 288b2c353e debugging of kelondroRecords ... possibly synchronization bugs found
19 years ago
rramthun a1061495d4 Fixed some spelling mistakes and added some text which (should) make it easier to understand the options.
19 years ago
orbiter 0cdc58aaea fixed indexing of local domains.
19 years ago
orbiter 76b97e4d2a integrated geo-snap DBStressTest.java in dbtest
19 years ago
hermens ec1202edbe *) Fixes for httpd
19 years ago
theli e1c2d8ec5f *) Speedup "removed from queue"
19 years ago
hydrox 96930f0d2b *)added function to removed malformed URLs from urlHash.db
19 years ago
orbiter d007d14905 re-insert of migrateSwitchConfigSettings
19 years ago
theli 8862b6ba4b *) Corrections for code cleanup 1175
19 years ago
orbiter 0e88ba997e * added option to generate url-lists as plain text file or in html
19 years ago
orbiter 13fdebc50d added authentication for link deletion in search result
19 years ago
orbiter 37f88b4017 code cleanup
19 years ago
orbiter ec2b39c1ce code cleanup
19 years ago
orbiter 76618442e0 code cleanup
19 years ago
orbiter 8f1f2daa5e implemented interactive link deletion of search results.
19 years ago
theli 6d0f7e6988 *) Adding missing file
19 years ago
theli 44fa94ac52 *) Modifications for dbImport functionality
19 years ago
orbiter 28ddba8813 added vote-button images
19 years ago
orbiter dc778659fb fixed problem with time-out during result joint which caused OR behavior instead of AND beahvior
19 years ago
orbiter 3d8a5ae652 code cleanup
19 years ago
allo ae6a4650bc reenabling debugMode (60 Seconds timeout for *all* http connections)
19 years ago
theli bb1f73ec15 *) Bugfix for code cleanup
19 years ago
orbiter 7920e1547d code cleanup
19 years ago
theli 972b8ddd2a *) minor changes: using constants properly
19 years ago
theli 1c3750de57 *) Bugfix for code cleanup
19 years ago
theli 64478b1f02 *) Adding possibility to delete crawler queue entries using regular expressions
19 years ago
orbiter 1d6a6d1f85 code cleanup
19 years ago
orbiter a04930f025 code cleanup
19 years ago
low012 90b0eb144e just a typo...
19 years ago
theli 129b15f3e1 *) Correcting logging output of db importer thread
19 years ago
theli 7028412c54 *) Bugfix for NullpointerException in Java Finalizer
19 years ago
orbiter 420d56ce79 extended db-testing
19 years ago
orbiter ecf765ec33 temporary fix to make jrpm extension compilable with my netbeans environment
19 years ago
rramthun 8c0d982191 1.) Fix from Martin (he ist not at home...)
19 years ago
theli b604654c25 *) Adding possibility to do a settings migration on yacy startup
19 years ago
theli 8ed0aaae8d *) Adding content Parser for RPM Files
19 years ago
theli 0f769215b5 *) urlRedirector now uses http head requests to determine the mimetype
19 years ago
theli b62c36d2ab *) Bugfix for urlRedirector
19 years ago
allo 8f4259f1e3 md5Auth
19 years ago
theli 818d37ce44 *) Removing getSimpleName
19 years ago
theli b35c5a48bf *) First version of urlRedirector.pl script
19 years ago
theli bdf30117c1 *) Redesign of parser configuration
19 years ago
allo b86d1085e2 passwordAuth
19 years ago
theli 5bf70e6e14 *) Bugfix for serverClassLoader.java
19 years ago
theli d4ac3e25b1 *) Bugfix for file system link bug during detection of invalid URLs
19 years ago
orbiter adf75bc9fa better logging for invalid file path detection
19 years ago
orbiter 40621a5663 anhancements in ranking preparation and fixed problem with parser/mime recognition
19 years ago
theli c650b112ea *) Bugfix for relative URL Bug in Crawler
19 years ago
theli 7e670894d9 *) Suppressing stackTraces in proxyError message for "connect timed out" errors
19 years ago
theli 4e73035aef *) Bugfix for "too many open files" during index distribution
19 years ago
allo d8afe60e07 Bugfix for last Bugfix ;-).
19 years ago
orbiter 1b656f6b31 correction of bug from svn 1123
19 years ago
orbiter f57e2d67f5 shortened network overview (less columns fit easier on page)
19 years ago
allo 24d15eb0e8 moving the redirector code
19 years ago
allo 787c368696 synchronized redirectors and using the port.
19 years ago
orbiter 85282b1d98 enhanced YBR recognition and search result heuristics
19 years ago
allo 4776f3f815 squid like redirctors
19 years ago
orbiter b9cc9029e3 added ybr selection for remote search
19 years ago
orbiter 0e25020f51 added first generation and usage of YBR index-files. Enhanced overall ranking of search results.
19 years ago
allo 52a0237bf2 using Filetemplates for #[metas]# and other static includes
19 years ago
theli 90d6c6223b *) Adding color codes to network graphic legend
19 years ago
orbiter bfe51c7228 added generation of domain-list
19 years ago
orbiter 0ec54d9c5f enhanced CR-file handling and added first RCI-evaluation tests
19 years ago
theli 99fb26e499 *) Suppressing stackTraces in proxyError message for harmless errors
19 years ago
theli c2fe3a1670 *) Updating jMimeMagic Ruleset
19 years ago
orbiter 88e3234393 fine-tuning of rci-generation
19 years ago
orbiter a12759c1bf first try to implement a rci-computation from cr-files
19 years ago
orbiter 4a8e8f269e refactoring of cr-processing; new kelondro class to handle the attribute file format
19 years ago
orbiter 24dc0e0760 implemented cr-file processing and further transmission steps
19 years ago
low012 5cd1e9cef4 *) fixed some dirty code, idea analog to bit stuffing
19 years ago
orbiter 022530df7e small bugfix in kelondroTree
19 years ago
orbiter 9d9a87f445 limited htcache storage length
19 years ago
theli 8e308cf50e *) Possibility to change the server port on-the-fly.
19 years ago
theli d0dfccdb77 *) Making CrawlStacker pool configurable via GUI and config file
19 years ago
theli 3631cb1f6d *) deleting empty entities during index selection
19 years ago
theli ca26aab9b1 *) More debugging output for migrateWords
19 years ago
theli 9b35ae9027 *) Correcting wrong % values on IndexTransfer_p page
19 years ago
theli e6bf9d90a5 *) Fixing Problems with MalformedURLs during Word Selection
19 years ago
theli 86a9210264 *) indexing queue slots are now configurable via config file
19 years ago
theli 3c11d7b81c *) Bugfix for minimizeUrlDB
19 years ago
orbiter 9913049009 fixed outOfMemory bug caused by loops in kelondroTree during enumeration
19 years ago
allo f8f9d509d5 removed dead Code
19 years ago
allo 5918d3985e removed Debug Statements
19 years ago
theli bbb936b9ea *) Bugfix for not human readable content of PDFs while viewing the URL Content via GUI
19 years ago
theli 445e3a620f *) Avoid rejecting of html content by the crawler when the file extension is not set properly
19 years ago
orbiter a3fd0069f5 fixed bug in kelondroTree node iteration (rotation did not work)
19 years ago
theli fd58d5f8e6 *) Adding possibility to specify the interface / IP-Address where YaCy should bind to.
19 years ago
allo 889de6686c Migration in yacyVersion
19 years ago
theli 444a5a9368 *) Bugfix for Entries with null url in GlobalQueue
19 years ago
allo 3bbb932fa2 Bugfix for nullpointerexception.
19 years ago
allo 4976f97956 Logout Function on User.html
19 years ago
allo b74e990c74 better Logout function
19 years ago
borg-0300 ebac51df52 restore defaultRemoteProfile
19 years ago
allo 4daa4b00e9 logout function
19 years ago
borg-0300 5778428455 move cutUrlText to nxTools,
19 years ago
borg-0300 9158845c3b bugfix for snippet text null bytes
19 years ago
orbiter 6e81f2580d try to fix bug with storage of settings
19 years ago
orbiter f763923e0a added missing files for last commit
19 years ago
theli 9649d08171 *) More tolerant robots parser
19 years ago
orbiter 79818a320f introduced citation-rank transmission protocol and activate transport for anonymisation
19 years ago
theli 6f8d7d3bcd *) Adding first version of YaCy bookmarklet
19 years ago
theli 7e0647f692 *) Bugfix for userDB usage during authentication
19 years ago
theli 93cadb47b9 *) More tolerant robots parser for robots-files which missing empty lines between rule blocks
19 years ago
orbiter 02f8013013 auto-delete of corrupted word files during word-migration
19 years ago
orbiter d2731418bf added creation of global ranking files and changed url normal form usage
19 years ago
theli 6f9f8ed8f8 *) Automatic Reset of Stack Crawler DB on startup errors
19 years ago
theli fb766413d1 *) Changes on httpc dns caching
19 years ago
orbiter bc420c62f6 fixed htcache path generation (never change a running system)
19 years ago
borg-0300 795f488222 new urlNormalform version
19 years ago
orbiter c86d801b0f removed dyndns domains from dns caching
19 years ago
orbiter 6dc42a2392 detecting of loops in kelondroTree during last/first-Node search
19 years ago
borg-0300 17d2830394 see: http://www.yacy-forum.de/viewtopic.php?t=1416
19 years ago
theli dd24f0252f *) Searchword highlighting for info page
19 years ago
theli f9fb284fb7 *) Better handling of robots.txt files with incorrect keywords
19 years ago
borg-0300 a1406f4617 urlNormalform: no logging
19 years ago
borg-0300 72cde1d894 getCachePath: no logging
19 years ago
borg-0300 1fbd72f9e0 rename "index.html" to "ndx"
19 years ago
borg-0300 cd1107d85e added support for URLs with '?&'
19 years ago
borg-0300 5fb2b017cb small change
19 years ago
borg-0300 60e869f236 bugfix for last commit
19 years ago
borg-0300 544e4ea90e small change
19 years ago
borg-0300 00ab4d8723 cleaned, small change, Properties
19 years ago
theli b8ceb1ffde *) Adding better https support for crawler
19 years ago
borg-0300 d2507c6081 rename setJunior()... to orJunior()...,
19 years ago
borg-0300 e3179a6394 added getOwnSeedFile()
19 years ago
borg-0300 a803a509ae bugfix: port handling in HTCache
19 years ago
theli 3d0dfd4df4 *) Using StringBuffer instead of String concatenation
19 years ago
low012 452db479cd *) bugfix: "21" was displayed as &quot;21&quot; in yacyWiki
19 years ago
hydrox cb69047b91 *)cleanup access static methods and fields
19 years ago
hydrox 56b9f34411 *)removed unused imports
19 years ago
orbiter 5f68b6886b introduced new url-hashes for better ranking computation
19 years ago
orbiter aadace1285 fixed network image in search performance monitor
19 years ago
orbiter bb369c98de fixed search result ordering by date
19 years ago
hydrox 295aff52a3 *)added offline-browsing-support (onlineMode=0)
19 years ago
orbiter 4d1e56e4d9 fixed intermission-bug (removed 'break for intermission' of httpd-thread)
19 years ago
orbiter b058ecf0bc refactoring of image-generation; added experimental PNG encoder (not active now)
19 years ago
orbiter 7a9fc653e9 fixed 100% cpu bug in wikiCode
19 years ago
orbiter 1aa707d357 fix for http://www.yacy-forum.de/viewtopic.php?p=11866#11866
19 years ago
orbiter d42531e1b2 added auto-reset for NURL-DBs
19 years ago
allo 5526d2ff73 Basic WatchCrawler.html, which loades the Queues using AJAX.
19 years ago
allo 92c49b406b adminAuth with userDB and adminAuthenticated (fix for statuspage)
19 years ago
rramthun 27f180f24b Update of YaWoStat to 0.2.
19 years ago
theli 3b5d0eb053 *) Synchronizing robots.txt downloads to avoid parallel downloads of the same file by separate threads
19 years ago
theli 723e056c48 *) Bugfix for ClassCastException during SessionPool.close
19 years ago
theli e58e85363d *) Bugfix for ConcurrentModificationException while operating on seed properties
19 years ago
orbiter 2dc12c45cb small corrections to profiling generation
19 years ago
orbiter d656e2b433 added a memory-profile chart generation to database performance testing
19 years ago
theli 9319445f38 *) Minor changes to db performance test
19 years ago
theli ec3af327f7 *) Bugfix for Proxy-Authentication against remote proxy
19 years ago
orbiter 5b0911d7ea added new performance menu for search sequence configuration and monitoring
19 years ago
orbiter 4fa942511b de-serialized read and write access
19 years ago
orbiter 09a0e898e0 created database test application
19 years ago
orbiter 1ff0ced515 integration of an interface class for abstract access of kelondro indexed structures like kelondroTree and kelondroHashtable
19 years ago
allo ada06b0674 bugfix for Networkimage from Hydrox
19 years ago
allo e3f87f9dab Bugfix for not parsable Numbers (NumberFormatException when loading users)
19 years ago
theli d3ad712418 *) Bugfix for Seed file upload problem via ftpc
19 years ago
theli 9a2afe88d4 *) Deactivating unlimited timeout for persistent connections because this
19 years ago
orbiter 1aa4ba8b62 added post-search filtering of redundant urls (longer than existing cited)
19 years ago
low012 8e7b214e41 *) 5 inverted commas are needed instead of only 4 to strongly emphasise a text (closer to Wikipedia's syntax now)
19 years ago
orbiter 8d827cdb30 tried to fix problems with order of network list by last-seen (which could also improve the network picture)
19 years ago
low012 1e6cf9fd41 *) indented texts between escape symbols behave like indented preformatted texts now
19 years ago
theli 446e7e8bef *) Bugfix for Seed-Upload - Permission denied problem
19 years ago
orbiter 097009d910 experimental visualization of DHT access during global search (temporary)
19 years ago
orbiter 4dcbc26ef1 introduction of search profiles; very experimental
19 years ago
theli 6c48c3ce39 *) Bugfix for ArithmeticException during IndexTransfer
19 years ago
low012 fd1b08303e fixed a bug theli pointed out (indented <pre>-blocks)
19 years ago
theli 525c8dcbd4 *) Adding Traffic Statistic for Crawler
19 years ago
theli 9a5ab62928 *) Adding yacy specific X-YACY-Index-Control header which can be used by clients
19 years ago
theli 539f9e57aa *) Disabling RemoteProxy if remoteProxyName is null or empty
19 years ago
theli 5a25ad9109 *) Bugfix for useRemoteProxy4YACY and useRemoteProxy4SSL check
19 years ago
theli 02d9af1a70 *) Restructuring and extending of Remote Proxy Support
19 years ago
low012 222607ef0f *) added <pre>-tag for preformatted text to yacyWiki (as requested by theli)
19 years ago
allo 117a424d00 bugfix for sharing png/gif files in WWW/SHARE
19 years ago
theli af3060938b *) Bugfix for manual peer ping functionality
19 years ago
theli 6e3201b74d *) Bugfix in httpc.java
19 years ago
borg-0300 58b670201d now, changed HTCacheSize needs no restart
19 years ago
allo f97c303ebd rights for Admin and Proxy.
19 years ago
allo 97de600a68 another bugfix for share/www.
19 years ago
allo df147d0fb0 rightsmanagement for upload/download User - preparations for proxy and admin User
19 years ago
allo 2dfd6bf36a fix for networkimage
19 years ago
allo ec10220d57 Fix for last Commit: .class Files in htroot, not in the dir of the localized HTML-Files
19 years ago
allo 4db2080188 Bugfix for www and share.
19 years ago
theli 40777556c5 *) Connection Tracking
19 years ago
borg-0300 bcb0d6d5ff changed setLastSeen(long rd) to setLastSeen();
19 years ago
borg-0300 cdbaf637fb added
19 years ago
borg-0300 e642a5d8b7 more constants
19 years ago