Commit Graph

869 Commits (45c44ca9c8406e009447bcf8ba642b8c7c525a07)

Author SHA1 Message Date
theli c2fe3a1670 *) Updating jMimeMagic Ruleset
19 years ago
orbiter 88e3234393 fine-tuning of rci-generation
19 years ago
orbiter a12759c1bf first try to implement a rci-computation from cr-files
19 years ago
orbiter 4a8e8f269e refactoring of cr-processing; new kelondro class to handle the attribute file format
19 years ago
orbiter 24dc0e0760 implemented cr-file processing and further transmission steps
19 years ago
low012 5cd1e9cef4 *) fixed some dirty code, idea analog to bit stuffing
19 years ago
orbiter 022530df7e small bugfix in kelondroTree
19 years ago
orbiter 9d9a87f445 limited htcache storage length
19 years ago
theli 8e308cf50e *) Possibility to change the server port on-the-fly.
19 years ago
theli d0dfccdb77 *) Making CrawlStacker pool configurable via GUI and config file
19 years ago
theli 3631cb1f6d *) deleting empty entities during index selection
19 years ago
theli ca26aab9b1 *) More debugging output for migrateWords
19 years ago
theli 9b35ae9027 *) Correcting wrong % values on IndexTransfer_p page
19 years ago
theli e6bf9d90a5 *) Fixing Problems with MalformedURLs during Word Selection
19 years ago
theli 86a9210264 *) indexing queue slots are now configurable via config file
19 years ago
theli 3c11d7b81c *) Bugfix for minimizeUrlDB
19 years ago
orbiter 9913049009 fixed outOfMemory bug caused by loops in kelondroTree during enumeration
19 years ago
allo f8f9d509d5 removed dead Code
19 years ago
allo 5918d3985e removed Debug Statements
19 years ago
theli bbb936b9ea *) Bugfix for not human readable content of PDFs while viewing the URL Content via GUI
19 years ago
theli 445e3a620f *) Avoid rejecting of html content by the crawler when the file extension is not set properly
19 years ago
orbiter a3fd0069f5 fixed bug in kelondroTree node iteration (rotation did not work)
19 years ago
theli fd58d5f8e6 *) Adding possibility to specify the interface / IP-Address where YaCy should bind to.
19 years ago
allo 889de6686c Migration in yacyVersion
19 years ago
theli 444a5a9368 *) Bugfix for Entries with null url in GlobalQueue
19 years ago
allo 3bbb932fa2 Bugfix for nullpointerexception.
19 years ago
allo 4976f97956 Logout Function on User.html
19 years ago
allo b74e990c74 better Logout function
19 years ago
borg-0300 ebac51df52 restore defaultRemoteProfile
19 years ago
allo 4daa4b00e9 logout function
19 years ago
borg-0300 5778428455 move cutUrlText to nxTools,
19 years ago
borg-0300 9158845c3b bugfix for snippet text null bytes
19 years ago
orbiter 6e81f2580d try to fix bug with storage of settings
19 years ago
orbiter f763923e0a added missing files for last commit
19 years ago
theli 9649d08171 *) More tolerant robots parser
19 years ago
orbiter 79818a320f introduced citation-rank transmission protocol and activate transport for anonymisation
19 years ago
theli 6f8d7d3bcd *) Adding first version of YaCy bookmarklet
19 years ago
theli 7e0647f692 *) Bugfix for userDB usage during authentication
19 years ago
theli 93cadb47b9 *) More tolerant robots parser for robots-files which missing empty lines between rule blocks
19 years ago
orbiter 02f8013013 auto-delete of corrupted word files during word-migration
19 years ago
orbiter d2731418bf added creation of global ranking files and changed url normal form usage
19 years ago
theli 6f9f8ed8f8 *) Automatic Reset of Stack Crawler DB on startup errors
19 years ago
theli fb766413d1 *) Changes on httpc dns caching
19 years ago
orbiter bc420c62f6 fixed htcache path generation (never change a running system)
19 years ago
borg-0300 795f488222 new urlNormalform version
19 years ago
orbiter c86d801b0f removed dyndns domains from dns caching
19 years ago
orbiter 6dc42a2392 detecting of loops in kelondroTree during last/first-Node search
19 years ago
borg-0300 17d2830394 see: http://www.yacy-forum.de/viewtopic.php?t=1416
19 years ago
theli dd24f0252f *) Searchword highlighting for info page
19 years ago
theli f9fb284fb7 *) Better handling of robots.txt files with incorrect keywords
19 years ago
borg-0300 a1406f4617 urlNormalform: no logging
19 years ago
borg-0300 72cde1d894 getCachePath: no logging
19 years ago
borg-0300 1fbd72f9e0 rename "index.html" to "ndx"
19 years ago
borg-0300 cd1107d85e added support for URLs with '?&'
19 years ago
borg-0300 5fb2b017cb small change
19 years ago
borg-0300 60e869f236 bugfix for last commit
19 years ago
borg-0300 544e4ea90e small change
19 years ago
borg-0300 00ab4d8723 cleaned, small change, Properties
19 years ago
theli b8ceb1ffde *) Adding better https support for crawler
19 years ago
borg-0300 d2507c6081 rename setJunior()... to orJunior()...,
19 years ago
borg-0300 e3179a6394 added getOwnSeedFile()
19 years ago
borg-0300 a803a509ae bugfix: port handling in HTCache
19 years ago
theli 3d0dfd4df4 *) Using StringBuffer instead of String concatenation
19 years ago
low012 452db479cd *) bugfix: "21" was displayed as "21" in yacyWiki
19 years ago
hydrox cb69047b91 *)cleanup access static methods and fields
19 years ago
hydrox 56b9f34411 *)removed unused imports
19 years ago
orbiter 5f68b6886b introduced new url-hashes for better ranking computation
19 years ago
orbiter aadace1285 fixed network image in search performance monitor
19 years ago
orbiter bb369c98de fixed search result ordering by date
19 years ago
hydrox 295aff52a3 *)added offline-browsing-support (onlineMode=0)
19 years ago
orbiter 4d1e56e4d9 fixed intermission-bug (removed 'break for intermission' of httpd-thread)
19 years ago
orbiter b058ecf0bc refactoring of image-generation; added experimental PNG encoder (not active now)
19 years ago
orbiter 7a9fc653e9 fixed 100% cpu bug in wikiCode
19 years ago
orbiter 1aa707d357 fix for http://www.yacy-forum.de/viewtopic.php?p=11866#11866
19 years ago
orbiter d42531e1b2 added auto-reset for NURL-DBs
19 years ago
allo 5526d2ff73 Basic WatchCrawler.html, which loades the Queues using AJAX.
19 years ago
allo 92c49b406b adminAuth with userDB and adminAuthenticated (fix for statuspage)
19 years ago
rramthun 27f180f24b Update of YaWoStat to 0.2.
19 years ago
theli 3b5d0eb053 *) Synchronizing robots.txt downloads to avoid parallel downloads of the same file by separate threads
19 years ago
theli 723e056c48 *) Bugfix for ClassCastException during SessionPool.close
19 years ago
theli e58e85363d *) Bugfix for ConcurrentModificationException while operating on seed properties
19 years ago
orbiter d656e2b433 added a memory-profile chart generation to database performance testing
19 years ago
theli ec3af327f7 *) Bugfix for Proxy-Authentication against remote proxy
19 years ago
orbiter 5b0911d7ea added new performance menu for search sequence configuration and monitoring
19 years ago
orbiter 4fa942511b de-serialized read and write access
19 years ago
orbiter 1ff0ced515 integration of an interface class for abstract access of kelondro indexed structures like kelondroTree and kelondroHashtable
19 years ago
allo ada06b0674 bugfix for Networkimage from Hydrox
19 years ago
allo e3f87f9dab Bugfix for not parsable Numbers (NumberFormatException when loading users)
19 years ago
theli d3ad712418 *) Bugfix for Seed file upload problem via ftpc
19 years ago
theli 9a2afe88d4 *) Deactivating unlimited timeout for persistent connections because this
19 years ago
orbiter 1aa4ba8b62 added post-search filtering of redundant urls (longer than existing cited)
19 years ago
low012 8e7b214e41 *) 5 inverted commas are needed instead of only 4 to strongly emphasise a text (closer to Wikipedia's syntax now)
19 years ago
orbiter 8d827cdb30 tried to fix problems with order of network list by last-seen (which could also improve the network picture)
19 years ago
low012 1e6cf9fd41 *) indented texts between escape symbols behave like indented preformatted texts now
19 years ago
theli 446e7e8bef *) Bugfix for Seed-Upload - Permission denied problem
19 years ago
orbiter 097009d910 experimental visualization of DHT access during global search (temporary)
19 years ago
orbiter 4dcbc26ef1 introduction of search profiles; very experimental
19 years ago
theli 6c48c3ce39 *) Bugfix for ArithmeticException during IndexTransfer
19 years ago
low012 fd1b08303e fixed a bug theli pointed out (indented <pre>-blocks)
19 years ago
theli 525c8dcbd4 *) Adding Traffic Statistic for Crawler
19 years ago
theli 9a5ab62928 *) Adding yacy specific X-YACY-Index-Control header which can be used by clients
19 years ago
theli 539f9e57aa *) Disabling RemoteProxy if remoteProxyName is null or empty
19 years ago
theli 5a25ad9109 *) Bugfix for useRemoteProxy4YACY and useRemoteProxy4SSL check
19 years ago
theli 02d9af1a70 *) Restructuring and extending of Remote Proxy Support
19 years ago
low012 222607ef0f *) added <pre>-tag for preformatted text to yacyWiki (as requested by theli)
19 years ago
allo 117a424d00 bugfix for sharing png/gif files in WWW/SHARE
19 years ago
theli af3060938b *) Bugfix for manual peer ping functionality
19 years ago
theli 6e3201b74d *) Bugfix in httpc.java
19 years ago
borg-0300 58b670201d now, changed HTCacheSize needs no restart
19 years ago
allo f97c303ebd rights for Admin and Proxy.
19 years ago
allo 97de600a68 another bugfix for share/www.
19 years ago
allo df147d0fb0 rightsmanagement for upload/download User - preparations for proxy and admin User
19 years ago
allo 2dfd6bf36a fix for networkimage
19 years ago
allo ec10220d57 Fix for last Commit: .class Files in htroot, not in the dir of the localized HTML-Files
19 years ago
allo 4db2080188 Bugfix for www and share.
19 years ago
theli 40777556c5 *) Connection Tracking
19 years ago
borg-0300 bcb0d6d5ff changed setLastSeen(long rd) to setLastSeen();
19 years ago
borg-0300 cdbaf637fb added
19 years ago
borg-0300 e642a5d8b7 more constants
19 years ago
borg-0300 7b510b558a small change
19 years ago
borg-0300 ee7d847869 small change
19 years ago
borg-0300 d77b982083 small fix for last commit
19 years ago
borg-0300 b00cd5640b bugfix for 'hello.class java.util.ConcurrentModificationException:null'
19 years ago
rramthun a98bafb939 Changes to german language file
19 years ago
allo 43a127ff3a allow httpsTunnels to other Ports than 443. (if secureHttps=false)
19 years ago
allo 93c1cb9226 ipAuth works. thx theli.
19 years ago
allo 6430fa520e bugfix for broken HTDOCS
19 years ago
allo 4320425a17 ipAuth (this does not work yet)
19 years ago
theli 95abdeb685 *) Bugfix for nextElement function of URL Enumerator
19 years ago
orbiter 6260942590 changed search process: received indexes are now buffered and written to wordIndex after search
19 years ago
theli b7e21ec107 *) Adding DB import function which allows to import an foreign yacy DB (from directory PLASMADB)
19 years ago
borg-0300 7ee03acce0 new function cutUrlText added to shortens the URLs on IndexMonitor.html
19 years ago
allo b88a9584f8 New Errorpage
19 years ago
theli b177a80bb7 *) Bugfix for sendRespondError StackOverFlowException problem
19 years ago
theli 219acc1e8f *) Bugfix for wrong http version in response to http/1.0 requests
19 years ago
orbiter bc56a88cc8 further refactoring of search
19 years ago
allo 0f2f783e46 no no-cache for mediaExts
19 years ago
allo 7ca60f97bf localization Support for Includes
19 years ago
orbiter d29dfb0a12 refactoring of search / preparation for better search methods
19 years ago
allo 9ff2bd2f0e allow surfing, if no timelimit set.
19 years ago
theli 0ae166c522 *) Small changes to Index Transfer.
19 years ago
theli 461374e175 *) Restricting amount of files that yacy is allowed to open during index transfer/distribution
19 years ago
theli c8a35a0130 *) Adding new connection tracking page (currently only for incoming connections)
19 years ago
allo 141417821e limitless Accounts (set timelimit = 0)
19 years ago
orbiter b80b2fbdcc crawling peers now produce waves in network graphic
19 years ago
orbiter b45ffecd39 log to fix http://www.yacy-forum.de/viewtopic.php?p=11111#11111
19 years ago
orbiter 10d3627c90 changed word cache flush scheduling and removed possible locks
19 years ago
orbiter dced5c761e added 'corona' for crawling peers in network graphic
19 years ago
orbiter 4cf0d1eb6d less memory occupation in ImagePainter
19 years ago
allo 6bd9348bf1 small change
19 years ago
orbiter aae5af9686 imagePainter may now paint arbitrary large circles; small update to network graphics
19 years ago
allo be8e95d86a debug printlns removed
19 years ago
allo f1ff33177d reset Timelimits on Daychange
19 years ago
theli 54a97a7355 *) IfesL: Suppressing "Broken pipe" stacktrace in log file
19 years ago
theli a9e25c26e1 *) adding new sendRespondError method to httpd which accepts a template include file
19 years ago
allo 5605cc8018 TimeLimits
19 years ago
orbiter 6a72f06c40 resizable network picture + greater on click
19 years ago
orbiter 839db8869c added high/low priority for index adding
19 years ago
theli 3966b38360 *) Bugfix for userDB time limit calculation
19 years ago
theli 1688be8590 *) plasmaSwitchboard.java
19 years ago
theli e3a586d7bd *) Using serverByteBuffer instead of ByteArrayOutputStream
19 years ago
orbiter e9eb5e4b56 refactoring of index-entity join methods
19 years ago
orbiter 258fd9eb8e adding missing file for websearch refactoring
19 years ago
orbiter 77ae30063d refactoring of websearch process
19 years ago
orbiter 579b22d8ff small update to network drawing
19 years ago
orbiter 2b5829c3da small fix
19 years ago
orbiter e85989510a update to network image; added disconneced peers by disconnection time and changed colors
19 years ago
orbiter 4c7918f5b5 added shotdown to crawl stacker (moved from 882)
19 years ago
orbiter 2851658c2a re-integrated Martins last change to crawl stacker from svn 882 that I had deleted accidently
19 years ago
orbiter c83594528c integrated crawl stacker into thread control
19 years ago
orbiter 16a49c1c9d fix for graphics generation bug, see http://www.yacy-forum.de/viewtopic.php?p=10987#10987
19 years ago
orbiter d666b61b83 fix for news-deletion, see also http://www.yacy-forum.de/viewtopic.php?p=11000#11000
19 years ago
borg-0300 4180c422e8 cleaned, finals, Properties
19 years ago
theli 959eefbc4f *) Robots.txt parser/ppt
19 years ago
orbiter c1c94111b0 added new network picture at Network menu using the new image-servlet method
19 years ago
orbiter d98ed41f31 update to image painter and test on http://localhost:8080/imagetest.png
19 years ago
allo f65c939a60 userDB Auth
19 years ago
orbiter 5153ec0f3e update to image painter
19 years ago
orbiter 1b2db0b52a fix for file-share access; damaged some commits before by me :-(
19 years ago
orbiter 1a5d98cd6d better imagePainter example and fix for typo http://www.yacy-forum.de/viewtopic.php?p=10920#10920
19 years ago
borg-0300 afc5ef2819 cleaned, Properties
19 years ago
orbiter 60ab32c313 removed obsolete htmlPlotter
19 years ago
orbiter 06f4ac494a image-painter test; try with http://localhost:8080/imagetest.png
19 years ago
borg-0300 fb27428674 added restart to Status.html
19 years ago
borg-0300 0dcfc25d98 cleaned, finals, Properties
19 years ago
borg-0300 4191b21e73 cleaned, finals, Properties
19 years ago
orbiter f6cf3967de fix for compile-bug in svn 583 (Martin guck mal ob das richtig ist: fifo oder filo-stack?)
19 years ago
theli a2fa75e688 *) Asynchronous queuing of crawl job URLs (stackCrawl)
19 years ago
orbiter 01db66dc69 implemented image-servlets. the imagetest will stay there only for a limited time. Now images can be generated on-the-fly from servlets
19 years ago
orbiter f6a0e0f162 small bugfix to readFully
19 years ago
orbiter 6d5d0ac801 bugfix for startup problems
19 years ago
orbiter 5dc0d41900 bugfix in kelondroRA (hint by Martin)
19 years ago
orbiter 0c3a20d44f more + changed log for better understanding of outOfMemory bug and others
19 years ago
orbiter e5f8163203 fixed a bug with news; news moving could lead to shurtcut loop / 100% CPU; appeared when clicked on a 'Profile' news in Network menu
19 years ago
orbiter fbb5e36b80 documentation update
19 years ago
allo cd77078aa0 old Version restored before Release
19 years ago
allo a4b747fe97 ProxyAccounts based on userDB
19 years ago
theli 0fd9aa6c6e *) Bugfix: supportedFileExt Function didn't detect the file extension correctly because of missing conversion to lower case
19 years ago
theli 8a33c9b309 *) Bugfix: supportedFileExt Function didn't detect the file extension correctly if there was a dot
19 years ago
theli 28c5687ff9 *) Bugfix for "download of non supported file content" via crawler
19 years ago