allo
63a2616eb7
-If you click on "Administration", you can log-in.
...
-better Linktext on Status.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2863 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2a9d868f6d
- removed object cache from kelondroTree
...
- generalized object caching and added new object caching class
- added object caching wherever kelondroTree was used
- added object caching also to usage of kelondroFlex
- added object buffering (a write cache) to NURLs
- added many assert statements; fixed bugs here and there
- added missing close methods to latest added classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2858 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
777e39cea0
*) new template to display the dir-listing in xml format.
...
This can e.g. be done by using the url http://localhost:8080/share/?format=xml
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2856 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
2ba56f70a8
XML-safe put.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2848 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
6a73d858de
voting of surftipps can now be done with comments
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2846 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
5a6488256d
catch the "username too short" exception
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2844 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
ac13fa763a
*) bugfix for blacklist remove (blacklist was not informed about remove)
...
*) adding new soap service class for blacklist management
*) new junit class to test soap blacklist service
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2841 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
daburna
6251944012
-updated languagefile
...
-corrected little mistakes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2837 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
a831c83025
create servletProperties, with the servlet specific funktions from serverObjects
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2835 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
a17c43779f
removed wrong part of template
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2830 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
27f9e0b1c6
xml interface for blacklists
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2829 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
06854988da
- full integration of new LURL database in INDEX
...
- added migration method for urlHash.db into INDEX
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2819 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
52466067d8
*) Bugfix for ArrayIndexOutOfBoundsExceptions which occure because SimpleDateFormat is not thread-safe
...
See: http://www.yacy-forum.de/viewtopic.php?t=2995
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2810 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b79e06615d
- added new LURL.Entry class for next database migration
...
- refactoring of affected classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2802 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
daburna
c97984bbac
-corrected link and updated language file for simpleheader.template
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2799 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
karlchenofhell
b14a500b88
- removed debug output from PerformanceMemory_p
...
- added URL escaping (tested, nevertheless watch out for possibly broken URLs)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2797 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
karlchenofhell
ebf0da2a45
- now the fix http://www.yacy-forum.de/viewtopic.php?t=2974 works
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2796 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
karlchenofhell
98a84ddb12
- reverted last change partly, can't handle the template system
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2793 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
karlchenofhell
b5e40e2fa2
- fix for http://www.yacy-forum.de/viewtopic.php?t=2974 (no cache-sizes for new db)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2792 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
daburna
6d1db21d0b
-updated German language file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2790 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
77a59a115d
refactoring of indexing methods
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2787 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
688cbfb776
- bugfixing for flextable bug
...
- bugfixing for collection index bug
- several other bugfixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2785 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
74f09a0510
some more xml-backend files.
...
ConfigAdvanced_p.java: list settings after changing.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2784 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
a29b4d4fb5
extended Supertemplates for Headerincludes.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2780 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
3bebe72544
*) Default Rex.Exp. changed back to .*.*
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2778 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
daburna
ea9411f9d2
-surftips now working correct
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2775 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
5b114249ce
*) Bugfix for ViewLog problem with multiline logging messages
...
See: http://www.yacy-forum.de/viewtopic.php?t=2972
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2774 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
daburna
a1736675ca
-ups
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2769 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
daburna
2de939f544
-updated translation
...
-removed wrong spelling; there is only 1 p in the English tip. I think the surftipps.java have to be updated.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2768 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
c628df43a4
*) removed unused image-file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2762 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
50f2578c55
- some bugfixing and code cleanup
...
- now assortments can completely left out if they do not exist
before startup and collection index is selected.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2757 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a5dd0d41af
- refactoring of plasmaCrawlLURL.Entry to prepare new Entry format
...
- added test migration method to migrate the old LURL to a new LURL
the new LURL will be splitted into different tables for each month
this solves several problems:
- the biggest table in YaCy is splitted in different parts and can
also be managed in filesystems that are limited to 2GB
- the oldest entries can easily be identified, used for re-crawl und
deleted
- The complete database can be limited to a specific size (as wanted many times)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2755 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
e126598a0f
*) small enhancement to webinterface, progressbars are now not stretched images, but <div>'s with colored background
...
-> all skin files were set to use green progressbars (should be changed to colors fitting the skins appearence)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2751 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
581dd2ec72
*)Proper arrow-function on Network.html, but ordering is still broken. Perhaps someone could fix that?
...
*)Removed double creation of DATA directory. New warning message in case of insufficient rights.
*) Removed roland-ramthun.de-seedlist temporarily, because of server changes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2747 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
918b59dc5e
- bugfix for snippet profile (no delete button)
...
- bugfix for search process (avoided null pointer exception in case other peer does not respond)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2742 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2bb529cedb
added peer tags for peers in robinson mode
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2741 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
f7447894f1
*) fixed link to WatchCrawler_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2740 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
afbb547f3d
extended options for abstracts generation in remote search interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2739 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
3730ec3440
moving to a _p page.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2738 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c8f3a7d363
added snippet-url re-indexing
...
- snippets will generate an entry in responseHeader.db
- there is now another default profile for snippet loading
- pages from snippet-loading will be indexed, indexing depth = 0
- better organization of default profiles
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2733 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2e4aa6a170
refactoring of Advanced Config:
...
- removed settings that are in Basic Settings
- joined pages that belong together
- moved include pages from yacy/ to /
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2726 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0f10bdde22
more generic cache methods
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2721 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
440c6ee657
Implement alternative htcache layout
...
mostly according to: http://www.yacy-forum.de/viewtopic.php?p=26205#26205
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2718 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
226f2c5b2c
first version, of the Serverlet Debugger
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2717 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
e25172853a
fixed license notice
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2714 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
1d0c0edda3
first version of posts/get from the del.icio.us api
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2713 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1969522dc1
removed lowercase of snippets (and other things):
...
- added new sentence parser to condenser
- sentence parsing can now handle charsets
to do: charsets must be handed over to new sentence parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2712 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
07155ef3b0
*) added a few constraints to prevent exceptions when clicking on stop or pause on IndexCleaner_p.html when no thread is started
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2710 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
db294687ea
enhanced logging
...
- more logging output
- fix in log line preparation
- added filter to log page
- some small bugfixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2707 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
f17ce28b6d
*) plasmaHTCache:
...
- method loadResourceContent defined as deprecated.
Please do not use this function to avoid OutOfMemory Exceptions
when loading large files
- new function getResourceContentStream to get an inputstream of a cache file
- new function getResourceContentLength to get the size of a cached file
*) httpc.java:
- Bugfix: resource content was loaded into memory even if this was not requested
*) Crawler:
- new option to hold loaded resource content in memory
- adding option to use the worker class without the worker pool
(needed by the snippet fetcher)
*) plasmaSnippetCache
- snippet loader does not use a crawl-worker from pool but uses
a newly created instance to avoid blocking by normal crawling
activity.
- now operates on streams instead of byte arrays to avoid OutOfMemory
Exceptions when operating on large files
- snippet loader now forces the crawl-worker to keep the loaded
resource in memory to avoid IO
*) plasmaCondenser: adding new function getWords that can directly operate on input streams
*) Parsers
- keep resource in memory whenever possible (to avoid IO)
- when parsing from stream the content length must be passed to the parser function now.
this length value is needed by the parsers to decide if the parsed resource content is to large
to hold it in memory and must be stored to file
- AbstractParser.java: new function to pass the contentLength of a resource to the parsers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2701 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
bcf2b800b4
applied UTF-8 encoding parameter to yacy-internal protocol communication
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2694 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5a40ea7866
refactoring of wget string list generation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2692 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
dbc2e039bb
added time-out option parameter to call hierarchy
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2691 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b59d4576af
increased version number to emphasise that the snippet fix
...
_dramatically_ increased search speed
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2690 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d4c239e4be
- fixed problem in collection index with deletion of single url references
...
- added automatic deletion of not-found snippets after search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2689 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
00746ca232
identified and fixed search performance problem caused by
...
snippet loading. Some access to header-db had been twice and even
more times in some cases. Snippet resource loading fixed.
Furthermore the snippet loading during remote search within the
remote peer has been disabled, but can be switched on remotely by
new flag 'includesnippet=true'
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2688 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
4d9e1b43dd
surftipps appearance update
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2687 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
310f1c41cd
added option to see ranking scores in surftipps
...
and some cleanups
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2684 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7c0e6de366
bugfix for surftipps votes (wrong page)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2683 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3ad0709b53
added a delete button to crawl profile list.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2682 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
a2e3095044
*) Bugfix. Add missing plasmaParserDocument.close() calls
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2680 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
cd5f349666
*) Better handling of large files during parsing
...
Extracted text of files that are larger than 5MB is stored in a temp file instead of keeping it in memory
*) plasmaParserDocument.java; getText now returnes an inputStream instead of a byte array
*) plasmaParserDocument.java: new function getTextBytes returns the parsed content as byte array
Attention: the caller of this function has to ensure that enough memory is available to do this
to avoid OutOfMemory Exceptions
*) httpd.java: better error handling if the soaphander is not installed
*) pdfParser.java:
- better handling of documents with exotic charsets
- better handling of large documents
- better error logging of encrypted documents
*) rtfParser.java: Bugfix for UTF-8 support
*) tarParser.java: better handling of large documents
*) zipParser.java: better handling of large documents
*) plasmaCrawlEURL.java: new errorcode for encrypted documents
*) plasmaParserDocument.java: the extracted text can now be passed
to this object as byte array or temp file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2679 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
8b2ceddb91
*) Displaying servere and warning logging messages in different colors on ViewLog_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2678 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
df1629b05a
- code cleanup
...
- version 0.471
- moved surftipps to own web page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2676 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
ed8227d222
*) Bugfix for NullpoinerException in IndexCreateIndexingQueue_p.java
...
See: http://www.yacy-forum.de/viewtopic.php?p=25874
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2667 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
c0f7a4124c
*) Bugfix for soap templates
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2666 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
3433dfb5e2
*) Bugfix for soap search template: correction for resultCount tags, cdata for snippet tag
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2664 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
d42dcead1d
*) Bugfix renaming snippet tag in soap search template
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2663 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
97615af406
*) Restructuring of YaCy SOAP services
...
- general functions moved to abstract service class
- service class splitted into SearchService, CrawlService, StatusService
*) Bugfix for SOAP search services
- Attention: some xml tages where renamed
See: http://www.yacy-forum.de/viewtopic.php?p=25877
*) New SOAP service function urlInfo to view the parsed content of an URL
See: http://www.yacy-forum.de/viewtopic.php?p=25869
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2660 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
b0cab1e731
*)Adapted surftipps to use common 0/1 parameters
...
*)Added translation of WatchCrawler.html
*)Changed format of German translation. Formal description will probably follow.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2657 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
4922ab8920
try to fix a nullpointer on snippet generation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2653 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
d8fde14c3a
Make maximum number of words in DHT-In cache configurable at runtime
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2652 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
740696f6c3
*) few fixes XHTML-validation ( there is still much to do)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2648 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
57415b6889
*) Bugfix for surftipps UTF-8 problem
...
See: http://www.yacy-forum.de/viewtopic.php?t=2864
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2647 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
706572f18d
*) Bugfix for ArithmeticException caused by setting max crawling thread count was to 0
...
See: http://www.yacy-forum.de/viewtopic.php?t=2862
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2646 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
2d3b96eeba
bugfixes for surftipps
...
- added missing authorization check for votes
- second vote on same entry was possible after complete publishing of current vote
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2645 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
85f3617835
*) moved HTML from class-file to template-file (please check if it is valid HTML)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2644 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
9434dba8f2
*) corrected title of IndexCleaner_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2643 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
b6c7b91582
*) Parser now throws an ParserException instead of returning null on parsing errors (e.g. needed by snippet fetcher)
...
*) better logging of parser failures
*) simplified usage of plasmaparser through switchboard
*) restructuring of crawler
- crawler now returns an error message if it is used in sync mode (e.g. by snippet fetcher)
*) snippet-fetcher: more verbose error messages
*) serverByteBuffer.java: adding new function append(String,encoding)
*) serverFileUtils.java: adding functions to copy only a given number of bytes between streams
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2641 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
aa38721cf6
new features for surftipps
...
- new generation with less memory
- removal of doubles
- positive votes can generate entries without original news (so they can live on)
- link deletion on search results are now also negative votes for surftipps (but they may rarely hit any news)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2640 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e03427871e
enhanced surftipps:
...
- added switchh to show or hide surftipps
- more news contribute to surftipps
- added voting system for surftipps
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2638 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
e745b63c77
*) Bugfix for different behavior of indexDistributeWhileCrawling to other checkboxes on IndexControl_p.html
...
See: http://www.yacy-forum.de/viewtopic.php?t=2849
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2637 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
42173462f5
rename cutUrlText to shortenURLString;
...
other little things;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2635 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
16ba5d1b46
topwords: only [a-z] words, quality is better;
...
blank removes;
properties added;
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2632 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ec031eb993
first version of surftipps
...
see http://localhost:8080/index.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2627 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f453c14b5d
removed unreacheable catch blocks and unused imports
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2619 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
97d2a08ef1
*) restructuring needed to support parsing of documents using various charsets
...
- serverFileUtils.java:
-- adding methods to copy from stream to writer and readers to writers
-- moving httpc writeX methods into serverFileUtils class
- serverCharBuffer.java: removing inheritance from Writer class
- replacing htmlFilterOutputStream by htmlFilterWriter class which handles
content as char stream
- htmlFilterContentTransformer.java: deactivating getText mode
(still needs to be migrated to use char streams instead of byte streams)
- changes in several classes to use htmlFilterWriter instead of htmlFilterOutputStream
- changes in Scraper and Transformer classes to operate on chars instead of bytes
- httpdProxyHandler.java: bugfix. clientTimeout setting was missing in config file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2617 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3aac5b26da
- added automatic tag generation when a web page from the search results is added
...
- added new image 'B' in front of search results for bookmark generation
- added news generation when a public bookmark is added
- the '+' in front of search results has new meaning: positive rating for that result
- added news generation when a '+' is hit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2613 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
michitux
2d9496577f
Removed double labels for forms in Blacklist_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2610 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
michitux
aa46269eff
Less margin/padding for dls (e.g. in Messages)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2609 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
michitux
567c40f5f0
Bookmark/delete-links now visible when mouse is over the searchresult, in standard-compliant browsers with css, in Microsoft Internet Explorer via JavaScript
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2608 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
20e1754379
Various fixes for the languages
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2600 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d54144a4e3
fixed bad snippet behavior (hopefully)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2596 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5015e780c2
- simplified watchCrawler code
...
- changed display of watchCrawler slightly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2594 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
michitux
31d6cdea53
WatchCrawler.html now valid xhtml, added the class TableCellActive to default skin, please update your skins (sorry, I removed it before because I hadn't seen it in any html-file)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2590 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
9bed90f8dc
bugfix in js
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2587 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c42b011648
added watch crawler to menu
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2584 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
michitux
92157febcd
Bugfix for Blacklist_p.html: Adding of new patterns possible again
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2582 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
f4af607b79
*) just some typos
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2576 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e03740c306
small fix for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2575 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c89d8142bb
replaced old 'kCache' by a full-controlled cache
...
there are now two full-controlled caches for incoming indexes:
- dhtIn
- dhtOut
during indexing, all indexes that shall not be transported to remote peers
because they belong to the own peer are stored to dhtIn. It is furthermore
ensured that received indexes are not again transmitted to other peers
directly. They may, however be transmitted later if the network grows.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2574 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
6e2907135a
bugfixes for remote search server part
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2573 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
2c6f2a1f74
First language fixes for new XHTML-layout
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2572 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
cf9884e22b
first attempt to implement a secondary search
...
this is a set of search processes that shall enrich search results
with specialized requests to realize a combination of search results
from different peers.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2571 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
13d0cff257
right dhtml.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2568 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
dfc0ac1958
syntax error fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2565 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
6e03f61daa
fix for highlighting searched words in snippets
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2564 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
michitux
3bbe6a77da
Smaller font-size for tables in PerformanceQueues_p.html and PerformanceMemory_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2560 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
michitux
d6204fd956
Forms in Blacklist_p.html splitted as suggested by KoH to avoid wrong submits when pressing [enter]
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2559 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
michitux
b573f5b4c2
New layout in Blacklist_p.html, more padding and margin for fieldsets
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2558 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
michitux
48d8da44d1
Design changes: less margin in fieldsets, search form in yacysearch.html not centered, smaller rows in IndexMonitor.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2557 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
michitux
140c3e1db9
Some bugfixes: updated ids for labels in DetailedSearch.html, fixed a template-bug in Network.html and added a workaround for a bug in the template engine in IndexTransfer_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2556 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
75b198bc02
- updated references to indexContainer
...
- more bugfixes and debugging for indexAbstract processing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2555 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
4f9e42d5ed
more changes towards better join-search
...
- fixed problems with index-abstract generation
- added analysis output for index abstract receive
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2551 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
8219ce6c67
bugfix inn DetailedSearch form names
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2550 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
462c64a935
removed superfluous file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2549 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1137605edf
- small change to DetailedSearch layout
...
- version 0.463 for new xhtml interface
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2548 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
michitux
31393312d0
New XHTML-template for a large part of the frontend, for details see http://yacy-websuche.de/wiki/index.php/Dev:XHTML
...
If you don't use the default skin, the style will be broken or at least not complete.
YaCy now has two css-files: base.css in htroot/env and the skin. In base.css the layout and black/white text-formating-rules are defined. Colors are only defined in the skin.
The skin is now very easy to read and to change. If you want to make more changes than the colors you see in the default-skin, feel free to use the full power of css, but you are warned: The code is still not ready and may change, but we try to avoid changes which affect anything in the default-style.
Translation will be broken too because the language-files contain HTML-Code which has changed.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2547 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
82a6054275
- fixed bug with new indexAbstract generation
...
- added partly evaluation of indexAbstracts during remote searches
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2544 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
fded1f4a5d
*) better handling of maximum file size limit in crawler
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2543 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
7b1881754d
*) Corrections for FF search plugin
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2540 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
74d1dea30b
changes towards better join-search
...
- added generation of a compressed index within remote peers during global search
- added selection of specific urls within remote peers during secondary global search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2539 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
4a494464af
*) splitted form to avoid unwanted remove of selected entries as suggested by KoH
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2538 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
63893003be
*) Adding settings page for the crawler which allows to specify a file size limit and the timeout to use.
...
*) adding first version of maximum filesize check for the crawler
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2534 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
ecbce206b7
*) Bugfix for UNRESOLVED_PATTERN in threadpool configuration
...
See: http://www.yacy-forum.de/viewtopic.php?p=25377#25377
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2533 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
92e986bb91
*) adding missing return prop (requested by allo)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2532 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
f0529fe53e
update for ftp urls
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2531 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c543028dd4
fixed double/missing null check for LURLs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2520 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
96c6e4e322
- enhancements to detailed search page
...
- enhancements to search ranking computation process
- removed bugs in postranking
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2516 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e33eb528ba
fixed DetailedSearch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2514 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
9340dbb501
fixed all possible problems with nullpointer exception for LURLs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2513 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
ff4362b02d
some more fixes for new plasmaCrawlLURL.load behavior
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2511 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
35b70f164c
*) Status_p.inc: link to memory configuration added
...
*) startYACY.bat: comment added
See: http://www.yacy-forum.de/viewtopic.php?p=25311#25311
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2500 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
4866868c0e
added write cache for LURLs
...
This was necessary to speed up the index receive process during global search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2498 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
8a0e35618b
enhancements to search result preparation
...
- added detailed count on remote search results
- enhanced search sequence during remote searches (doing local search in sequence)
- strict adherence to timout limits
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2497 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
dae763d8e3
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2495 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
413e6b9855
*) direct access to responseheaders of sbQueue.Entry removed to make it more http independent
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2489 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
2126c51906
*) bugfix for ViewFile.java. Wrong http header were used
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2488 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
7a35b8e237
*) direct access to responseheaders of sbQueue.Entry removed to make it more http independent
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2487 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
3870d615e3
*) setting htCache.Entry fields to private
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2485 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
5847492537
*) next step of restructuring for new crawlers
...
- IndexCreate_p.java: correcting problems with ftp urls
- URL.java does not cutout the userinfo anymore
(needed to transport authentication info in ftp urls, e.g. ftp://username:pwd@ftp.irgendwas.de)
- plasmaCrawlLoader.java:
-- hack to re enable https urls
-- adding function getSupportedProtocols
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2482 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
4e2a950ac9
*) next step of restructuring for new crawlers
...
- avoid using the http crawler class directly. Using the interface class instead
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2476 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
f94131c13d
*) Bugfix for Blacklist_p.java
...
- avoid nullpointerexception
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2475 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
eb9b138986
*) next step of restructuring for new crawlers
...
- conversion of the crawler pool into a keyed object pool
- crawlers are now loaded based on the url protocol (of course works only for http now)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2473 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
1395aae742
*) starting restructuring which is needed to add crawlers for additional protocols
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2472 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
857a2d76a2
*) better handling of server shutdown
...
See: e.g. http://www.yacy-forum.de/viewtopic.php?p=25234
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2471 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7df572756a
fist step+attempt so solve the snippet marking problem.
...
See: http://www.yacy-forum.de/viewtopic.php?p=22855#22855
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2469 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
f3ac4dbbb9
*) better handling of server shutdown
...
See: e.g. http://www.yacy-forum.de/viewtopic.php?t=2584
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2468 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
57dda1a92c
*)again fixing for wrong version display, now totally working with double instead of float
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2464 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
18b6876860
new cache flush configuration settings
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2460 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
27a159b401
* documentation update
...
* removed doc from release
* release information in doc/News.html
* release 0.46
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2442 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d78b824e85
fixed problem with default path after first start-up
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2440 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
c2264962d1
*) Fixed a bug.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2438 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
b387bd47db
*) Added a Wiki Code help page and links to it at every textbox Wiki Code can be used in. Maybe this will encourage people to play around with the Wiki and the Blog more.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2437 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
38c4248814
Some language updates
...
Removes the ; behind Slovenky in language list
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2430 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
23dd972608
fixed memory calculation in performanceMemory web page
...
fixed also maximum cache size computation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2429 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1ce3c22761
better memory control:
...
- added memory monitor for preNURL-db in performanceMemory
- changed default memory assignments
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2427 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
39b4c26bdc
more memory control:
...
- catchup of OutOfMemoryError in server threads
- automatic adoption of word cache size after a Short Mem Cycle
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2426 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3e9d509c39
some small fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2425 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
479861a3cf
*) Value entered in searchfield will not get lost anymore when link "more options..." is clicked. If Javascript is disabled or function does not work for any other reason, there should be no change to current behaviour.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2424 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
16993e84dd
replaced non-7bit umlaut ascii
...
@Franz: sorry, ich hab hier ein ant das daran rumzickt. Bitte in deinem
Namen ein 'ss' statt der sz-Ligatur benutzen
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2422 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0187c60010
because of a bug in the JRE 1.4.2 there was no memory protection
...
see http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=4686462
this commit fixes the bug by using a memory-computation patch.
All uses of Runtime.maxMemory had been replaced by serverMemory.max
The bug is not present any more in Java 1.5
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2419 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
4eca0f8830
*) fixed PPM calculation for multiple indexer-threads
...
*) fixed totalPPM calculation and added total PPM to Network.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2418 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
6ad471ef96
* applied many compiler warning recommendations
...
* cleaned up code
* added unit test code
* migrated ranking RCI computation to kelondroFlex and kelondroCollectionIndex
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2414 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
9add56dc09
*) Cursor gets placed in search field when page is loaded. If Javascript is disabled or function does not work for any other reason, there will be no change to current behaviour.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2411 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
34831d2d9f
*) Check validity of crawl filter reg.exp. before adding it into the crawler queue
...
See: http://www.yacy-forum.de/viewtopic.php?p=24671
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2410 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
5e0b6f8f83
*) sorting peer name list on Blacklist_p.html
...
*) restructuring of sharedBlacklist_p.java
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2405 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
6c8366aea1
*) Bugfix for blacklist import function
...
- wrong property name
- list was accidentally imported into a new blacklist file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2404 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d0000a15d6
adjusted opensearchdescription to match requirements of A9
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2403 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
248627ab92
added open search compatibility
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2401 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
eee44be602
*) adding an interface for customized blacklist classes
...
- now it's possible to use a customized blacklist engine
instead of the default one
- this can be done by configuring the property BlackLists.class
See: http://www.yacy-forum.de/viewtopic.php?t=2108
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2397 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
79f27c298e
*) next bugfix for blacklist
...
- added items were not displayed properly
- bugfix for disabled usage
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2395 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
4abc04dac0
*) make Blacklist_p.html more failsafe if no blacklist file is available of the user has entered empty strings
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2394 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
28c84e5b57
*) Bugfix for NullPointerException in Blacklist_p if blacklist directory is empty
...
See: http://www.yacy-forum.de/viewtopic.php?p=24563
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2392 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
66f1eb07d9
*) Bugfix for IllegalArgumentException in transferURL
...
See: http://www.yacy-forum.de/viewtopic.php?p=24560
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2391 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
d2e8e76218
*) now it's possible to configure the yacy blacklist separately for dht, search, proxy, crawler
...
See: http://www.yacy-forum.de/viewtopic.php?t=2541
http://www.yacy-forum.de/viewtopic.php?p=24516
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2389 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f43c90fa98
fixed handling of null referer in crawlOrder
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2384 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
23a99b8283
Small changes to the language
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2383 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
abf22f6e60
removed url normalform computation from htmlFilterContentScraper.
...
This method was implemented in de.anomic.net.URL
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2377 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
718fbc2dae
enhancements in kelondroCollectionIndex:
...
* synchronized array and index objects
* auto-fix function for slightly corrupted index entries
* generalized internal access methods
also extended kelondroIndex interface to support ordering access
which is used in kelondroCollectionIndex for string comparisments
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2366 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ec5149ff3b
fix for busyCacheFlush detection
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2365 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f58283def2
better control of index flush
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2364 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
80b6c90d54
enhancements to prevent blocking during dht transfer receive
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2362 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
4fb8fddd99
*)made the domainlist of the blacklist sorted
...
if a new domain is added it is still appended to the end of the list and sorted in with next refresh, may need a fix.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2361 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
d56f06401e
- Cache known URLs during indexReceive to avoid getting blocked during loadedURL.exists() whenever possible
...
- Small logging updates
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2359 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
c09f734d06
*) offer router configuration on ConfigBasic.html
...
- checkbox to allow router configuration is shown if
- a) the UPnP forwarder is installed
- b) a UPnP enabled router was found
- c) no other forwarder was configured
See: http://www.yacy-forum.de/viewtopic.php?p=24264
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2358 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
dcbb4d0a6b
Display the size of HashBlacklistedCache on PerformanceMemory page.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2357 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
c7b6389ca1
*) renaming indexDistribution.dhtReceiptLimitEnabled property to indexDistribution.transferRWIReceiptLimitEnabled
...
so that the default value is taken over by all peers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2356 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
988341cf81
*) some comments added
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2352 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
d54767f634
*) last step of removing embedded html from dir class
...
- migration finished
*) dir list now sorts the dirlist entries.
- directories are listed before files
- files are sorted alphabetically, case insensitive
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2351 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
96b774e427
Adding link to newsletters as agreed in forum.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2350 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
8283df2d77
*) first step of removing embedded html from dir class
...
- dir list generation uses templates now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2349 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
279b1d969d
Integrated new indexing data structure 'collections' into the main class
...
for indexing, the plasmaWordIndex.
The new data structure is ready-to-use, but currently disabled.
It can be activated by setting the static
plasmaWordIndex.useCollectionIndex
to true. This shall be done for testing purpose.
The new index is stored to
DATA/INDEX/PUBLIC/TEXT
The directory PLASMA shall be used only for crawler in the future.
Attention: during testing the data structure in INDEX may change,
and created indexes with the new data structure may get useless.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2348 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
132cd7da45
no need to copy dir.*
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2346 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
0164321160
fix for the actions (uploading/deleting, loggin in, ...)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2345 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
9183d21f25
renamed new index class to old name
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2342 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c4e922885a
replaced indexURLEntry by new class that uses a kelondroRow.Entry object
...
to store the index entry. This is another step to move to the new database structure.
A side effect of this change is, that index storage uses much less RAM space,
which affects the index RAM cache.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2341 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e357599f92
* fixed problem with indexContainer iteration from RAM:
...
indexContainers from RAM must be cloned explicitely to prevent
side-effects on stored indexContainer objects in Cache
* changed behaviour of urlReference deletion from indexContainers:
deletion does not user retrieval of all Elements from the assortments
* added textual configuration of kelondroRow and kelondroColumn definition
* update of kelondroRow usage in yacyNews
* modified kelondroAttrSeq to use modified kelondroColumn parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2339 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
8b77afd72c
some fixes to new container merger
...
and some code cleanup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2336 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
6e676224d0
*) adding support for upnp
...
A new port forwarding method for upnp was added.
If this method is enabled, yacy automatically determines an UPnP
capable internet gateway and configures the gateway port forwarding
settings properly.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2328 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
417ed5102e
redesign of database iterators:
...
an iteration of key elements in kelondroTree databases is no longer supported.
this is now replaced by an iteration of kelondroRow.Entry objects from the database
Iteration of keys from the database was mostly followed by retrieval of the row
from the database, whcih caused unnecessary database load.
The index selection was also redesigned to use the new row iteration methods.
This affects many funktions, most important is the DHT selection routine which is now much faster.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2327 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ad692fc6c7
implemented option to extract nurls from the database
...
(plus some iteration enhancements for nurls)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2325 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5f72be2a95
some redesign of EURL storage
...
* store() is now called explicitely
* more urls are written to the EURL table
* the EURL stack does not store the complete entry any more, now only the URL hash
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2323 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
58df8b7bbf
a large collection of different changes
...
* mainly for the transition to the new indexing database structure
* a bugfix for an endless loop inside kelondroTree iteration
* a bugfix for bulk read inside a kelondroTree iteration; the bug caused that some elements had been iterated twice
* very strong speed enhancement for url/domain extraction
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2320 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
b3c569f706
*) renaming of function getTransferedEntitySpeed to getTransferedEntrySpeed to avoid confusion
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2308 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
01363bc7f6
missing file for the supertemplate demonstration.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2307 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
67c486a023
some example Code, how supertemplates can be used.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2304 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
7b0e2521bb
Support for a supertemplate, which can do all thing, a normal template can do.
...
Its a layer under the servlets, this means, #[page]# will be replaced by serverletcode, the rest can be set by you.
(TODO: if we use this for layout, we need to read "TITLE" from the servlet's tp, to set it outside of the servlet.)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2302 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
ff39a7a0d1
Overlay for welcome.*
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2299 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
b5ec7de936
Correction to last commit + spelling
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2296 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
8e08125657
security fix (known path on yacy host / known path on remote ftp server)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2292 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3879a0ecd0
replaced java.net.URL usage by use of new class de.anomic.net.URL
...
This shall be seen as an experiment to exclude all cases where
there could be a DNS lookup during URL comparisment.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2290 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
933a9e02ab
fix for broken build
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2284 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
360056b30c
fix ajax bug (no valid xml)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2283 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
f4d200ffa2
typo
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2281 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e22cbaee97
- extended logging for preload
...
- reduced preload-time for IndexImport_p.java
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2278 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
92f4cb4d73
added option to configure the start-up delay time for kelondro database files.
...
the start-up delay is used to pre-load the database node cache
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2276 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
675d1081a4
code clean-up: switched off unused variables
...
(bitte solche Variablen die nicht benutzt werden vermeiden.
Ich habe hier ein strafferes Warning an, da bekommt man die
immer angezeigt)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2273 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
31b5d8980e
*) Bugfix for basic config redirection bug
...
see: http://www.yacy-forum.de/viewtopic.php?p=23503
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2269 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
068d82c4c2
Important update of YPStats
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2258 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
b594ee9a5a
*) Adding possibility to configure if the http proxy should send the
...
X-forwarded-for header (requested by TeeSee)
See: http://www.yacy-forum.de/viewtopic.php?t=2577
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2257 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
0e9192a622
Updated YPStats_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2253 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hydrox
8ba8e2b7d9
*) added cache for blacklists urlhashs recieved by DHT. DHT does not request URLs listed in this cache.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2251 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
db2405533a
New YPstats possibility.
...
Users can enter the details of their system configuration and we are able do work-out profiles for special uses and hardware-configurations.
Default DB running on yacy-forum.de, but URL can be changed.
User can see all data, which will be submitted.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2249 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
53cbcc6d6e
Implement emergency break in index receive when the limit of the ramCache is exceeded by more than cacheLimit
...
See: http://www.yacy-forum.de/viewtopic.php?p=22911#22911
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2248 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
4cc6e6551f
bugfix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2245 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
66964dc015
removed high/med/low from kelondroRecords cache control.
...
this was done because testing showed that cache-delete operations
slowed down record access most, even more that actual IO operations.
Cache-delete operations appeared when entries were shifted from low-priority
positions to high-priority positions. During a fill of x entries to a database,
x/2 delete situation happen which caused two or more delete operations.
removing the cache control means that these delete operations are not
necessary any more, but it is more difficult to decide which cache elements
shall be removed in case that the cache is full. There is not yet a stable
solution for this case, but the advantage of a faster cache is more important
that the flush problem.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2244 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
b20496e42b
*) make DHT DoS check configurable (requested by KoH)
...
- check can be disabled via property indexDistribution.dhtReceiptLimitEnabled
- upper bound can be configured via indexDistribution.dhtReceiptLimit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2234 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
032b3fdd94
allow Creation of gettext only with password, because it causes high cpu-usage.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2227 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
c264cda678
support to parse gettext files and to generate updated files, where only the new strings are empty.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2222 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
f95c006dc2
generation of empty gettext files from yacy html-files
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2218 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
0621106ef3
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2214 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
6fe2fed87e
cookieauth works with static Admin.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2208 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
4ca0857c0c
*) Index transfer now considers the pause time send by busy peers during
...
index transfer / index distribution
See: http://www.yacy-forum.de/viewtopic.php?p=22647#22491
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2205 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
958408ca4a
bugfix for httpauth logout.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2203 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
b23703f260
using cookieAuth.
...
logout for httpauth seems to be broken :-(
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2202 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
bd22634c44
HTML-login, logout fixed.
...
TODO: If you login with the form, then logout with the form, and then try to login with httpauth, the first try will fail.
(should logged_out be resettet in ipAuth? but if there is ipAuth before proxyAuth, the logout would be broken. Maybe a combined method can help.)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2200 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
3f1ebc097e
Limit the size of the DNS cache to 5000 and the age of the entries to one day.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2199 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
d7a3fdb18b
no white pages, when clicking cancel on the password-dialog
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2198 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
ac772d4ef0
more RAM for our powerusers ;-)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2195 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
11123416f3
Form-Login function.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2193 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
251b3b636e
some refactoring for js
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2191 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
d2dc848902
*) correcting validation of proxyStoreHTCache in ProxyIndexingMonitor configuration
...
See: http://www.yacy-forum.de/viewtopic.php?p=22663
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2188 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
38a1410361
Don't test a remote peer's seed during hello.respond as its IP might not be proper, especially while still virgin
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2187 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
5625937d1c
Language improvements
...
One very minor HTML fix
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2181 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
71228cfc56
*)added ip to Blog.xml
...
*)added possibility to import Blog.xml-files
*)included german translation for new Blog-features
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2178 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
7b47055d6c
*)added Blog.xml for backup and exporting purposes, no importing at this time
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2177 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
3af867c7ba
*)fix for broken subject in Blog-News
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2175 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
962bc705d4
Fixed broken link
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2174 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b4efd7fc4b
changed default number of search results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2169 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
5041d330ce
refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2150 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7b3b12888c
refactoring: integrated indexContainer abstraction layer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2149 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
bc94a714b2
Better explanation for the auto-dom-filter.
...
Some javadoc.
Small change to DetailedSearch.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2146 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
196b8abb30
refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2144 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
24686e50a2
- fixed a caching bug
...
- added counter for cache delete to distinguish between flush and delete
- changed some default paramenters for cache size settings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2143 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
4d8f8ba384
added cache-performance analysis for node caches
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2140 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1b4a27cd99
added monitoring for new miss-cache
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2137 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
cda087f43b
- integrated cache miss storage into object cache
...
- removed cache-miss handling from indexURL
todo: new Monitoring in PerformanceMemory_p
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2132 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
757ec28430
refactoring: better data capsulation for indexURL
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2131 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
fd27d55385
One more table in ConfigBasic by Kebron
...
Nicer blog-newssymbol by Kane
HTML corrections/improvements by /me
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2130 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
61078b3885
*) adding support for delayed shutdown
...
- needed by Ismael to receive the Steering page properly on shutdown
- now the steering page should always be displayed properly in the web browser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2129 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
97393196fa
*) Avoiding wrong java heap size settings.
...
Xmx must be greater or equal Xms
See: http://www.yacy-forum.de/viewtopic.php?p=21782
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2128 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
8b7626f8d1
*) Automatic redirection of browser if user changes port settings in ConfigBasic
...
See: http://www.yacy-forum.de/viewtopic.php?t=2415
*) If ssl is available, the browser conntects to yacy via https on yacy startup
See: http://www.yacy-forum.de/viewtopic.php?p=21649#21649
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2127 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
955462d6b8
Some HTML cleanup/validation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2126 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
e7199c6c7e
*)fixed "Umlaute"-Bug in Blog
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2125 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
ee1cc99c2f
*) fixed some minor bugs in blog
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2123 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
90d569d70f
refactoring of index management:
...
url storage is part of index management; moved plasmaURL to indexURL
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2122 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a930be4ba3
refactoring of index management:
...
generalized the index entry
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2121 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7dd57a3828
added a busy-time estimation at DHT/RWI-Receive
...
to be done: usage of this value on client-side
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2116 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
fcec40fcc6
*) don't accept messages without subject or payload
...
See: http://www.yacy-forum.de/viewtopic.php?p=21656
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2115 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
82b2bc6932
patch for index-transfer DoS problem
...
see http://www.yacy-forum.de/viewtopic.php?p=21627#21627
note that this function will make the index-transfer functionality void
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2114 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
df7e1d9df3
Changes to plasmaURL and subclasses:
...
- Improve performance of plasmaURL.exists() by remembering URL-hashes that are not present
- Use a more realistic estimation of memory usage by the existsIndex cache
- Routine cleanup of the existsIndex to limit its memory usage
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2113 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
70ef53a89d
html fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2112 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
a474669338
start with refactoring of index management
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2110 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
(no author)
63a08307c2
Updated WikiLink
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2109 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
bfc1a6a383
interface update
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2108 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
20958acfd8
- fix for display problem for new blog news banner
...
- created 'real' ip-based links instead of '.yacy'-links
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2103 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
19c6e67003
- added generation of news for blog entries
...
- added display of blog banner in Network view
- extended lifetime of blog, wiki and crawl news
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2102 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
f08e33680c
Added Blog-news-symbol as requested.
...
I think I will change the character distance a little bit later.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2101 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
df068cf23c
*) adding first version of native SSL support for yacy
...
VERY EXPERIMENTAL!
See: http://www.yacy-forum.de/viewtopic.php?p=18516
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2096 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
55ea4cbfe6
*)reverted patch for memory-display issue
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2095 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
ba9798dcb7
better fix for
...
http://www.yacy-forum.de/viewtopic.php?t=2370
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2093 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
53d9ab6db7
*)fixed bug in PerformanceMemory_p.java which caused negative memory-values on big peers
...
see http://www.yacy-forum.de/viewtopic.php?t=2370
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2091 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
9c5ec2c8db
*) fix for broken html on IndexTransfer_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2089 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
theli
bcc950c533
*) Bugfix for Index Transfer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2088 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
fb064fdbee
Many additions/corrections to the German language file
...
Increased default time for DHT distribution, because many people complained about the high load on their systems, see http://www.yacy-forum.de/viewtopic.php?p=20922#20922
Avoided problems with some browsers and ampersands, see http://www.htmlhelp.com/tools/validator/problems.html#amp
Removed nearly invisible "bug" in menu
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2087 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
586b256627
*)fixed Blog-bug with german Umlaute
...
*)corrected wrong html in blog
see http://www.yacy-forum.de/viewtopic.php?t=2330
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2083 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
9938c252dd
better Errorhandling for proxyAccounts
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2082 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
015d044c25
tried to fix some problems with latest changes to httpc
...
very experimental!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2078 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
26e3216bcc
update to profile fetch behavior
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2076 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3e31820c3d
- corrections to PerformanceMemory display of object cache
...
- configuration of object cache size in kelondroTree initializer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2075 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
fd7c17e624
added virtual host support:
...
all yacy-to-yacy communication now send the <peer-hexhash>.yacyh
virtual domain inside the http 'Host' property field.
This shall enable running a yacy peer on a virtual host.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2074 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
29b1b0823c
added monitoring of new object cache to performanceMemory page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2072 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
465319caf3
*) HTML-Tags in headlines and author names were not filtered.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2061 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
799c04091d
Bugfix for Spam-Bug (Header manipulation)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2057 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
97c6a70b71
*) Fixed XSS vulnerability. I was able to crawl a PDF that caused the loading of an image in the admin's browser.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2056 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f9c953481a
fix for icq+jabber icons
...
see http://www.yacy-forum.de/viewtopic.php?p=20533#20533
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2046 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
007b8008c2
-spelling/translation
...
-adding hint for text-browsers
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2045 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b0036249c1
added some attributes to network picture
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2032 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
dbe96e6541
added hand-over of search filter and prefer ranking to yacy protocol
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2029 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
ae0bdf5d71
*) added status indicator for Jabber
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2025 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
00a5d435e2
- fixed some bugs with domain filter
...
- added new ranking filter "prefermask": urls that match the filter are ranked better
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2022 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
b00756378f
adopted ViewProfile to be used in search interface to fetch local profile
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2021 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
41afccaf34
small update to search interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2020 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
14d6e476c9
tried to solve some problems with new picture viewer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2019 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
aaaaf88ecd
*)fixed error when setting empty language/skin
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2016 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d0dd8b14d2
fixed picture tag and presentation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2014 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
51999578bf
fixed bug created with last commit of borg
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2013 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
00e768b259
added Picture button to search results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2011 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
daburna
7f167be945
small update of German language file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2008 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
f0833b0328
introduced simple search interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2007 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
bd283b8443
fixed bugs:
...
- null pointer exception during startup of a robinson-configured peer
- wrong time calculation of default value of re-crawl option
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2005 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
52d3d7b008
Added the new chatscript by Allo and _cato
...
The usual language stuff
Reordered superseed.txt after reliability
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2003 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c5087710a4
fixed type/cat properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2002 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
47b541b2d1
added better option handling in yacysearch
...
added depth option for image presentation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2001 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c9e16bfd48
first try to insert image search (does not work yet)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@2000 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
auron_x
0bf2eb4813
*) fixed Blog updating timestamp on edit (now always keeps creation-date)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1997 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
83e0e765ec
redesigned some parts of the html scanner & parser
...
to better support image tags
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1995 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e2e8d0c188
some kind of refactoring of yacysearch:
...
made 'room' for new picture search result presentation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1993 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
6b63e26cbb
- removed search function from index.html/java, only imput left
...
- added media fetcher/crawler class (not ready yet)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1992 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
low012
80ef2355a8
*) added login link to blog
...
*) added copyright notice to blog.java
*) deleted some whitespaces in the code
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1991 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
d8d0ac29c3
added image-viewer servlet that can do:
...
- each image that is requested is stored in the cache
- the image is taken from the cache if exists there
- the image can be scaled
The purpose of creation a scaled image is because of copyright problems
In a further stept the retrieval of not-shrinked images is restricted
to either access from localhost or with given authentication
This servlet can be used for image-preview purpose after an image search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1989 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
e566d1d8d6
some bugfixes regarding new crawling options
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1980 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
c7f1300300
-fixes for last commit
...
-some more ranking attributes (comments only)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1979 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
860a7b545b
enhanced input options for crawl start
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1978 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7a650d0023
several bugfixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1971 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
57fc0cf063
added ranking icon to Network.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1970 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
59d52fb4a9
fixed some problems with crawl profiles
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1967 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
44d72f06c4
more Caching
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1965 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
918445a2f4
Bugfix for last commit.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1964 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
219d847aaa
fix for appearance of radio buttons
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1963 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
8cac4a1e73
syntax fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1962 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
7310d2de1f
small fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1961 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0c9b61820e
enhanced re-crawl settings
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1960 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
708cc6c8d9
fixed some bugs for auto-filter and added monitor in profile list
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1959 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1f32ad8fd9
very small enhancements to indexCreate page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1958 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
c58789177f
bookmarkCache
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1956 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
rramthun
42b0b10a95
-Adding Windows Media to types which are not sended compressed
...
-Renaming writeandzip to writeandgzip to avoid confusion about type of compression
-Adding new startup message to windows script
-The usual language "enhancements" ;-)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1953 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
63f39ac7b5
added 3 new crawling steering options:
...
- re-crawl by age of page (enter in minutes)
- auto-domain-filter
- maximum number of pages per domain
NOT YET TESTED!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1949 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1fc3b34be6
some pre-work (without function yet) to implement:
...
- re-crawl (by age of last crawl)
- auto-crawl-filter by crawl depth (to be explained..)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1948 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
0a4c2e89ed
remote crawl orders are now only accepted if sum over all
...
queues is less than 100 (the indexing queue was not measured before)
see also: http://www.yacy-forum.de/viewtopic.php?p=19374#19374
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1947 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
1f4412a146
adopted isListed to discussed new behavior as discussed (url, getFile)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1940 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
cb23fc3d83
keywords added
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1934 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
1258df8133
no "[0-9]+" in topwords
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1933 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
6c70f4a0cf
renamed wordHashes for a word hash set generation to wordHashSet
...
This was done because the wordHashes iterator will get another integer
parameter and then conflicts with the wordHashes set generation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1921 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
dba02f399f
starting of re-design of kelondroTree iterator
...
- new access to iterator
- added many IOException handling in other Classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1914 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
allo
d2f34a2e94
skin in DATA/HTDOCS (works after upgrade, works when only DATA is writable).
...
preference of skinfiles:
-style.css will be overwritten on every new SVN, if "DATA/SKINS/"+currentSkin+".css" exists.
-DATA/SKINS will be overwritten with defaultskins from /skins
so develop your skins in DATA/SKINS, and put them into skins for distribution.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1913 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
orbiter
3286b1f498
re-organisation of lurl-creation and -stacking
...
this was necessary to prevent useless write to the database
in case of blacklist appearance of the url
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1905 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
hermens
289da326e5
*) Bugfix: remove blacklisted URL from loadedURL, when received via DHT transfer
...
see: http://www.yacy-forum.de/viewtopic.php?p=18976#18976
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1904 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago
borg-0300
9b94b374cc
Bugfix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@1903 6c8d7289-2bf4-0310-a012-ef5d649a1542
19 years ago