f1ori
a5a1f19368
* allow to force login for xbel, needed for yacybar
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4757 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
8d83febb95
*) BlacklistCleaner_p.java reports exception to log instead of System.err
...
*) changes in formatting for better readability in BlacklistCleaner_p.java
*) replaced test for necessary Java version (was 1.4.2, is 1.5 now)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4756 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
d4bce6affd
refactoring (initialized static fields, removed empty if/else, serialized some fields in serializable classes)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4755 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
19ca452666
updated language file
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4754 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
483e9a2066
- shifted tld recognition methods from yacyURL to serverDomains
...
- changed isLocal Property in such a way that it is possible to see if a domain is in the internet (and not intranet)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4751 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
27ab0a5f89
fixed XSS problem in ConfigProperties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4748 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d3715e02ae
removed double/redundant servlet Config_p
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4746 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
5813cc149f
fix for bad rssTerminal behavior
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4744 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d0b893523e
- protection against RAM overflow caused by new peer rss news
...
- more XSS protection
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4742 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9935e83c86
added new news window into the status page. At this moment it is just a test.
...
The news inside the window are about peer arrivals and departures, remote search accesses and crawls
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4739 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bac38cfa18
added very rudimentary peer news as rss feed. An example can be retrieved with
...
http://localhost:8080/xml/feed.rss?channel=PEERNEWS
to be extended and integrated in interface ...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4738 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
724bbdf9b2
refactoring of RSS reader
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4736 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d0e2830e01
enhanced the thread dump to make it usable for scripted remote-debugging
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4732 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
e024e3b9cf
added new default profiles to distinguish snippet fetch for local and global search
...
the difference is, that a local search will no not cause a re-indexing of loaded pages
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4731 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2c0c8f0f0c
SRU compliance according to
...
http://www.loc.gov/standards/sru/specs/search-retrieve.html
The example given on this page can be used to retrieve opensearch-compatible rss pages with YaCy
Try it:
The transcription to YaCys search servlet address is
http://localhost:8080/yacysearch.rss?version=1.1&operation=searchRetrieve&query=dinosaur&maximumRecords=1&recordSchema=dc
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4730 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
e90282da1c
added experimental javascript terminal for rss feeds (not used yet anywhere yet, expect the worst)
...
.. possibly to be used as content for iframes within monitoring pages
not ready yet!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4727 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
1995faef8d
- refactoring of Colage back-end: move to plasma package
...
- renamed also the plasmaCrawlResults to have a consistent naming for url and image queues
- added a double-check for the images
- added additional queues for the images: all worse-quality images go there, so the queue can be used also if no sizes are given; no image is lost
- added a cleanup for the stacks so they cannot flood the memory
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4722 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
5e3ce46339
- better logging when rejecting a url because it is not in declared domain
...
- more XSS attack protection
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4720 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6d1be66822
- longer refresh rate for reload of WatchCrawler page forwarding to indexing start (does not work in IE)
...
- better names for search pages
- Release 0.58
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4719 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
2149728227
- major rework on YaCy-UI
...
- search results are retrieved from rss/xml, no other servlet needed
- added double accordion sidebar menus
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4718 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
512f48e7d6
- removed unused methods
...
- fixed xss attack on peer list in CrawlStartSimple
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4714 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
14384e7a45
deactivated unnecessary and very CPU-intensive deletion check for blacklisted URLs in index receive
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4713 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
f1ori
701f769c66
* removed comma, which caused invalid xml
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4711 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3c76342619
- added servlet to configure the search page greeting line
...
- added information output about the current network definition in the network servlet
- better description and usage of profile entries in User Profile servlet regarding FOAF format
- reformatting of menues at status page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4710 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
f1ori
b9602e891a
* added CrawlProfileEditor_p.xml for monitoring in yacybar
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4708 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d03940f2ec
- included patch from http://forum.yacy-websuche.de/viewtopic.php?p=7193#p7193
...
- fixed problem with crawl profile editor after deletion of a crawl profile
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4706 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6155f0e634
last small changes until main release
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4699 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9a32a4c328
fixed concurrentModificationException during hello-process
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4693 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
d8677ba611
fixed ConcurrentModificationException in HttpConnectionInfos
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4690 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
8313d58ae7
- integrated the collage into the Web Visualization menu
...
- added a counter for the public and private queue on the page (testing..)
- fixed wrong public/private categorization
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4686 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
82bf9ac1c8
- added Collage servlet from datengrab and modified it:
...
* all images are queued
* private/public is respected
* inserted into switchboard
* added collageQueue class that stores all the queued images
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4683 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
959f448e5f
- disabled redirects in proxy (so client sees real path)
...
- added connection stats (only connections currently in use)
- remove "old" connections (closed or idle for some time)
- synchronized shared parts of proxyHandler
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4682 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
5d1fbb25e7
fix for bad deploy:
...
- the name of downloaded release files is adopted if the httpc delivers uncompressed tar.gz files (the .gz is removed from the file name)
- the deploy method is able to handle tar-file (not tar.gz-files)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4679 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
202a3adb3e
refactoring of HttpClient Writer processes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4678 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
444dce7e81
more performance hacks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4676 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
c3342e1178
- removed class with only one static method
...
- removed connection method with too long time-out
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4672 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2c1c3bb6eb
- some refactoring (sorry Daniel, hab in deinem Code rumgewütet)
...
- fixed broken downloads (flush was missing)
- different problem handling when download is corrupted
- different default values in yacy.init
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4669 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
d96e2badc7
- fixed POST in proxy
...
- prepared http connection tracking
- refactoring (mainly moving StreamTools to serverFileUtils)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4668 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
14404d31a8
- enhanced performance graph (more info)
...
- added conditions for rarely used logging lines to prevent unnecessary CPU usage for non-printed info
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4667 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
ab330cfdca
Network.html: removed ; from location
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4658 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
41e9c5723c
try to fix shown location (instead of 'Europe/de) JakartaHttpClient/3.')
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4656 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
117ae78001
speed enhancement for reading of eco-table indexes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4647 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
5c3c1fdf41
replaced httpc with Apache Jakarta Commons HttpClient (includes some refactoring ;)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4640 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
764a40e37d
speed enhancements for crawler and url retrieval (affects also search speed)
...
- concurrency for LURL-fetching: this can be done using a concurrent lookup into the separated url databases. Concurrency is possible because there is no IO during lookup. The more LURL-Tables are present, the better is the speedup. More CPUs will increase speed
- because a large number of LURL-lookups are made during crawling (for double-check), the LURL-Lookup speed enhancements enhances also crawling speed
- search speed also profits from LURL-lookup enhancement
- changed some flushing parameters in word index caching which should make better use of large word index caches and should speed up indexing
- removed flush chunksize parameter, because this was only useful for IO path enhancement feature which was removed some weeks ago to prevent blocking and deadlocks during search requests
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4628 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
b2150057d2
removed unnecessary cleanup method
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4625 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
f1ori
76eac114ed
* define global javascript-variable with var to get rid of warnings
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4624 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
b63cf2fc1c
*) added button to Crawl Profile Editor to delete all terminated crawl jobs (only visible if there are terminated crawl jobs)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4620 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
f1ori
2aed6bb3f7
* return valid xml in xml-bookmarks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4619 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
4c3f1b67ad
*) refactoring of Blacklist_p.java (moving entries might be slightly slower, but the code is more tidy now)
...
*) added edit functionality for blacklist entries
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4616 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
f1ori
466d49e90c
* added login-parameter to be able to force authentication
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4613 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
f1ori
c67350f138
* use putXML with forXML-parameter to ensure urls are valid xml (problem was & in url)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4611 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
f1ori
98a03249f3
- optimize selectall-javascript-function (in firefox more then 10 times faster now)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4610 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
0241d070bc
added concurrency to indexing process:
...
- the methods {parsing, semantic analysis (condensing), structure analysis (web structure)} in the serialized indexing path had been made concurrent.
- four BlockingQueues handle concurrency and hand-over of the indexing objects, the last object in the queue is stored into a blockingQueue of maximum size 1 to serialize the process for storage (which uses IO and therefore here should not be deserialized)
- a concurrency of (CPUs + 1) is default. Single-CPU users will profil from the change because large files cannot block the indexing process any more.
- removed the secondary indexing thread, which is superfluous now. Concurrency is default for all users.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4609 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bca87f1e38
- refactoring of serverThreads: renaming to distinguish busy-threads and blocking-threads
...
- added blockingThreads which are threads that are not driven by pause times but by BlockingQueue lookup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4606 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
968c775025
- preparation of parsing/indexing queue for concurrent execution
...
- remote crawl receipts are now transmitted concurrently in separate threads (makes remove crawls much faster!)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4605 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
7f9f639d20
- refactoring and abstraction of index reference (urls) handling: blacklisting is part of reference filtering
...
- refactoring of word/phrase handling: word abstraction from condenser becomes part of index element handling
- removed unused code parts from condenser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4603 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d6050b9ffb
- separated the LURL data storage and Crawl result stack for process supervision.
...
this is another step to enable multiple, concurrent fulltext-indexes
- another try to make the yacy-httpc more stable
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4602 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
8e889de50b
*) Added Lotus' patch ( http://forum.yacy-websuche.de/viewtopic.php?t=979 ), user will be taken back to last opened page after making changes in Advanced Settings.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4601 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
93633abed8
- removed some debugging code from search process - should speed up now
...
- added some profiling code to search event - more time details in PerformanceSearch_p.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4594 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
541b817502
refactoring of switchboard queueing
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4591 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3e44293f07
- fixed a problem with thread pools in row collection
...
- added a line-viewing feature in threaddump
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4587 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
e43051b125
- fixed Threaddump output (html-escaped ie. <init>)
...
- in EcoFS converted comments to javadoc
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4586 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
433ff855f7
- fixed another concurrency problem in collection sorting
...
- fixed a typing problem that was introduced in svn 4579 and caused the crawl monitor to fail
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4585 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
5fde618337
changed display of y-marks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4583 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
1618bd5505
added submenu
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4580 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
7150b463ff
changed handling of default values and database paths:
...
- the default files yacy.init and for the network definition is now moved to the path defaults
- the httpProxy.conf is renamed to yacy.conf
- the DATA/INDEX/PUBLIC is renamed to the actual network nickname, which should be freeworld or sciencenet
more menu entries
- added apfelmaennchens alternative search page to the menu
- added the new thread dump page to the server log menu point as submenu
modifications
- modified the thread dump page: sorting by thread type
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4575 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
54cb097ea4
added .trigger("update") after paging
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4574 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
82f17ccee2
just an example sidebar
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4573 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
3c710f22cd
added server side driven pagination for search tabs
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4572 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
7fd094fcbe
small bug in ftpc: did cot compile in Java 1.5
...
Please set compiler to Java 1.5-compliance
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4570 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
0a593a4e4a
small changes to Threaddump Servlet
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4569 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
995b5a2b27
added Threaddump Servlet, see http://forum.yacy-websuche.de/viewtopic.php?f=9&t=862
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4568 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
d1b9f50b94
added "delete Release" to Update Page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4564 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
3d122c125c
added "current installed release" to Update Page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4563 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
368b8735b5
added 'close tab' function
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4560 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
fa1090113d
- next try to fix the networking problem:
...
set the maximum transfer size to less than MTU=1500-52: buffer size <= 1448
- some refactoring of transfer methods (naming)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4558 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
f63bd26268
fixed search performance / dynamic display of results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4557 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
5530b8e1ca
reverted changes to yacy protocol classes: they caused the sciencenet to loose connections
...
a comparisment with the main release 0.57 had been made: this showed a stable network
This is an emergency operation to ensure availability of the sciencenet network.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4553 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
b3d4571a5d
fix for bad opensearch file format
...
did you know that yacy has a built-in rss feed reader? try:
http://localhost:8080/FeedReader_p.html?url=http://www.tagesthemen.de/xml/rss2
it can be used to fetch search results from other yacy peers:
http://localhost:8080/FeedReader_p.html?url=http://sciencenet.fzk.de:8080/yacysearch.rss?search=yacy
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4551 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
b4ed937f1e
- modified zone navigation (does still not work correctly)
...
- added dht switch in network definition
- 0.574
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4550 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
c75fa90206
adjusted display of search results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4547 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
7a902424af
adjusted display of search results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4546 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
e0c481decb
not class file in SVN .. I guess it is a mistake
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4545 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
8c15fbf7d1
simple and fast fix for LogStatistics_p
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4544 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9eddc1506b
- one try to fix the httpd problem
...
- fix for handling of collection index that appears when removing elements
- added another navigation method (stub, not working yet)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4543 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
b4b370586a
fixed the box headings
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4541 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
f7a0804e83
small optical change for the sidebar
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4540 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
c5f378c7a4
additional images
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4539 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
6ebc9b7325
additional images
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4538 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
3c686e4e0e
for testing puposes - new user interface based on jQuery and Ajax
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4537 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
f238478cc3
for testing puposes - new user interface based on jQuery and Ajax
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4536 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
cb8625ca67
for testing puposes - new user interface based on jQuery and Ajax
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4535 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
2b43ea9f9d
for testing puposes - new user interface based on jQuery and Ajax
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4534 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
12cac31be8
for testing puposes - new user interface based on jQuery and Ajax
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4533 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
94280b0a39
temporary check-in for testing puposes - new user interface based on jQuery and Ajax
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4532 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bfed9c2da6
- some refactoring in search process
...
- separated sidebars in new search interface and placed them in their own files
which can be put in into the search page like plug-ins
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4529 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
5fd990cc84
sorry, bad commit!
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4527 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
275a226cc5
refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4524 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
danielr
fbe335db73
consistent use of de.anomic.server.serverMemory to get information about memory statistics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4522 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
1dce2f1079
more multithreading support:
...
- replaced some synchronized classes by classes from util.concurrent
- used a util.concurrent.SynchronousQueue to implement a persistent sorting thread in
the very basic kelondroRowCollection which supports sorting with a second thread
in case that a double-core processing CPU is used
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4517 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3f2b18a4e7
fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=905&hilit=&p=5979#p5979
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4513 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
096d0f7240
- better look for Indexcleaner
...
- corrected commas
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4512 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3f321ece7d
added a search history to the new search page
...
the history distinguishes between different users and identifies them by their ip
a history is only shown to the user who submitted the search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4510 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
c48e25d784
- fixed selection box for topwords
...
- fixed parser detail in condenser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4509 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bd2d9f75ae
introduced search navigation column on new search page
...
An alle JavaScript-Profis: die Anwahl einer neuen Suchseite über die Selectbox (hinter Category)
funktioniert bei mir nur mit Firefox, nicht aber mit Safari oder Camino. Kann da mal jemand
gucken woran das liegt?
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4508 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
87a8747ce3
- enhanced recognition, parsing, management and double-occurrence-handling of image tags
...
- enhanced text parser (condenser): found and eliminated bad code parts; increase of speed
- added handling of image preview using the image cache from HTCACHE
- some other minor changes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4507 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a7abee3578
- fixed some data types in new search stack
...
- added image domain presentation to image preview
- added new search page to menu
- added automatic re-search when an old search profile is requested and a crawl is ongoing,
to fetch newly crawled entries
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4501 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bedd8dfbe2
- added image sorting by image size. This is the default now.
...
This is performed using a 3-stage sorting process:
- sort by relevance, then do snippet-fetch
- sort snippets by relevance then do image link extraction
- sort image links by image size; unknown sizes are handled like small sizes
- only the exact amount of images as requested are shown
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4499 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
727feb4358
- fixed some bugs in ranking computation
...
- introduced generalized method to organize ranked results (2 new classes)
- added a post-ranking after snippet-fetch (before: only listed) using the new ranking data structures
- fixed some missing data fields in RWI ranking attributes and correct hand-over between data structures
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4498 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f4c73d8c68
- fixed highslide usage
...
- some enhancement to index management, better types
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4497 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3441ec3928
- some small changes to highslide integration to get it working... (does not work yet)
...
- performance enhancement for url list parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4495 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6c3cd2b4f2
- added new way to watch images from the image search:
...
they appear as separate, floating window above the search results,
not in a new window
- added highslide javascript library for feature mentioned above
- removed dir servlet. This thing was not used as it was supposed to be (as an example applet)
and was a major problem for intranet-indexing when files are hosted on the same peer.
- added yacy-httpd-internal directory listing. Because YaCy is a search engine,
directory listings are similar to search result listings. Intranet indexing from the same peer
will get nice index pages for document collections.
- removed unused test applet
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4494 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
61a81820e3
- refactoring of search tracker
...
- added link to search history to repeat the search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4493 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
22b8525c84
better option to delete words form the index
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4490 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9b9f3e7193
added missing rdf for ViewProfile
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4489 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
4079c38ce0
- probably slightly better default ranking
...
- added experimental right column to new search page (no function, only container)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4487 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
8fd5e52f04
added basket icons and experimental gif animation class
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4485 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
451cde3d92
added images folder
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4484 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
94e256e13b
* removed single Blogview, now links direct to BlogComments.html
...
* some other small changes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4483 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
cfe499d8c9
first test of alternative search interface (only a stub but working!)
...
try http://localhost:8080/yacy/user/ysearch.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4482 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ff5969901c
modified dir servlet to cooperate with intranet indexing from the own HTDOCS repository:
...
- removed md5 file generation (spoils the won repository)
- removed comments in file share (was never used)
- moved dir list comparator to other place (maybe solves problem, lets see)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4481 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
52a7cf0cc9
re-added list interface (blacklist imports need them)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4480 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a10f27197f
experiments with openstreetmap
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4479 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
00f5f917de
- more refactoring to blog
...
- fixed moderate comment bug. see http://forum.yacy-websuche.de/viewtopic.php?f=9&t=860
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4478 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
c1b9a03304
* some refactoring to Blog
...
* changed default sort order to reverse (newest first)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4475 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
766a04bc06
fixed sort problem in Blog. see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=639
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4474 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
fc54d4519e
some more XHTML strict errors
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4471 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
fcd9d954eb
changed tableCount into tableSize
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4470 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
0441990f3e
small corrections
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4469 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
3ef91a3bc9
fixed more XHTML strict errors
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4467 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
3636526bd6
replaced re-crawl/min-age as suggested here: http://forum.yacy-websuche.de/viewtopic.php?f=9&t=198
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4466 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
00b8764a67
fixed some XHTML strict errors
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4465 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
a047e7f830
replaced irritating "re-crawl"
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4463 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
22485dcca8
rename opeer -> oseed
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4462 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
77ba446332
seedDB helpers update/cleanup
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4461 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bd63999801
- faster search: using different data structures that avoid multiplr calculations
...
- no more table copy for error-eco table
- optional table copy for lurl-entries
- more abstractions (less single constant strings)
- better logging (using host names instead of ips)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4459 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
8358652fa9
some small changes to blog
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4457 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
159aaf8889
re-introduced global search limitation when index receive is switched off
...
this was necessary because othervise robinson peers did also global searches, which cannot be a wanted effect
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4456 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
a8d336c379
undo 4448 (no bug)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4455 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
d1758eb17d
mistake corrected
...
cleanup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4454 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
9f69b1f08f
small change (2)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4449 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
5ac71729d8
small change
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4448 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
85a82950e0
seedDB helpers
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4447 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ebe07b736c
added stub for new search page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4446 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
efd5807a7c
- some renaming of variables to support DC
...
- initial 120mb RAM for fresh peers
- release 0.57
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4445 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
40a0591942
Fixed numberbug in Blog, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=639 . This wont fix existing Blogentrys (comes later).
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4443 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
df548f444f
one more NPE patch for a search item case
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4440 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ff6b69b37e
fix for NPE in access tracker
...
fix for NPE in word index
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4439 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3c7b94c119
- fix for online caution delay settings, see
...
http://forum.yacy-websuche.de/viewtopic.php?f=6&t=738&p=4723#p4723
- removed remote search limitation for non-dht-peers according to discussion in
http://forum.yacy-websuche.de/viewtopic.php?f=15&t=793&hilit=&p=5277#p5277
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4438 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
a981cd5ab7
ignore folder tags...on request of daburna
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4436 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a1e9e6e2e6
fix for search result page navigation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4431 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
7404256997
- no more search time-out!
...
- fixed a bug with last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4430 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
cd3e0d6f03
tried to fix another eco bug
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4429 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
89169d54fd
fixed search result preparation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4427 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
7c29bc4a87
#updated German languagefile
...
+set spacer between topwords
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4426 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a8a5df4a51
- more dublin core naming of page metadata
...
- better presentation of result counters in search results
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4420 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9d693ee635
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4415 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
0f5c4abaca
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4414 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
974fea7933
added term-frequency ranking
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4413 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
1a296af6ff
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4412 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
4a80902081
- added ViewProfile as rdf in foaf syntax
...
- added link to rdf and vCard version on html page
- can be seen on http://localhost:8080/ViewProfile.html?hash=localhash
- more generics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4411 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
1b930a6702
#small corrections
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4409 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
f5ab90d964
added auto reload graph option by Lotus
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4407 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
d3ce9ebffe
added tooltips to folder tree
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4406 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
eb6bdf49c1
fixed import Netscape Bookmarks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4403 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
cb91cc5c7c
fixed import Netscape Bookmarks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4402 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2485681002
added termination control for RotateIterator
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4399 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
15397298dc
- refactoring of indexControlRWIs: moved statics to own class; better Dublin Core naming
...
- fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=759&hilit=&p=4866#p4866
- some bugfixes in EcoTable according remove method
- switched more tables to Eco: crawl Profiles, htcache, seeddb, newsdb
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4397 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
2dc994515d
fixed a typo
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4396 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
98e0cd7b87
fixed export bookmark link
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4395 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
d59f9e0c17
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4394 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
7b400756c4
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4393 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
30bf4bdc48
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4392 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
b32b025d4b
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4391 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
29146ff855
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4390 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
6dc319fc32
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4389 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
3afdcd0d59
fixed problem with utf-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4388 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
13668830b7
fixed problems with utf-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4387 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
34e5422675
adjusted code for bookmarksDB.getFolderList()
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4386 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
aa53a46937
adjusted code for getFolderList() and cleanTagsString()
...
added input for folders in add/edit bookmark
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4385 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
eebc688f37
moved Login link to submenu
...
added Folders to add/edit bookmark form
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4384 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
6f9f821481
added XBEL Export for YaCy Bookmarks. Tags are strored as
...
<metadata owner="Mozilla" ShortcutURL="tag1,tag2"/>
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4381 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
4e70dff8cf
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4379 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
41a3ff8ccc
*) removed unused imports
...
*) some generics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4374 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
c0fbab9cca
*) heading, trailing and double commas are removed since they are unnecessary
...
*) trailing and double slashs in paths are removed, they are not only ugly, but also caused infinite loops
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4373 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
089faf1a00
*) added login link at bottom of page
...
*) empty tags will not be displayed any longer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4372 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
634430c48a
- more logging
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4368 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
d288987a93
replaced isEmpty() with equals("")
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4367 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
a870ac32b8
reorganized code and added folders; this update might have overwritten latest changes by orbiter - sorry!
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4364 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
62a5df5bfc
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4363 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
7aa94f17da
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4362 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
373fface89
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4361 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
f319bbe4c8
adjustments for folder tree
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4360 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6eb8321cb0
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=752&p=4815#p4815
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4359 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
4c631d912e
added folder view; limited tag view to top25
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4356 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
e68b133b35
added JavaScript for folder tree view
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4355 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
85dc62c16f
refactoring: more dublin core - compliant naming
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4354 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
efd0b8371a
- added parsing of Dublin Core - compliant metadata (see RFC 5013 and ISO 15836) to html parser
...
- refactoring of plasmaParserDocument to use Dublin Core - compatible property names
- redesign of url handling in parser and condenser (less String-to-yacyURL conversion)
- more generics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4352 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9eb746863d
interface enhancements for eco records memory statistics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4348 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f6cfb97b7f
added a test servlet (to be used to analyse the remote crawl xml bug)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4344 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f4e9ff6ce9
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4343 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
45339c3db5
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4341 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
94f21d9403
activated new kelondroEcoTable file structure.
...
This data structure replaces almost all files in the PLASMA directory
also the collection.index and the LURL-db will be created as Eco-DB, if it does not exist before
existing Flex-databases will be used as they are (the is no data lost)
If you want to force the creation of a Eco-collection.index, simply delete the old index.
The Eco file system will only be used if there is enough memory.
The collection.index RAM limit is 200MB, if you have less, a flex-Table is createt.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4340 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
739f35d389
*) added previous/next links to blog (in case blog has more entries than get displayed on one page)
...
The blog still has a major problem: entries are displayed in random(?) order if there are several entries in the blog
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4339 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
71a67436ac
*) fix for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4329 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
352f733a86
*) added "previous" and "next" links that make it possible to navigate through lists of comments (needed if there are more than 10 comments to one postig)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4328 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
2018f33e7b
*) it was possible to post comments even if they were turned of if one knew the ID of a posting in the blog
...
*) Login link was displayed even if user was already logged in
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4327 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f3f02b08ec
no distinction between standard and pro releases in auto-updater
...
this did not work in 0.56 main (but should).
Therefore it will be necessery to provide a hand-made 'virtual pro' (just renaming) release 0.57
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4326 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a6ca3b51be
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4322 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a5054c038d
- added large number of generics
...
- redesign of ordering structures in kelondro (old did not work with strict generics)
- 50% IO reduction during read access on kelondroFlex (ommiting of read on index table)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4320 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
eff372e20c
- Fixed alignment of heading 'YaCy -'
...
- Changed identation of html-file for better readability, added some comments
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4319 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
8bb21e98f4
div.bookmarkList angepasst - rechter Rand zur TagList
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4318 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
71bcf02d3a
- removed pro-version (is the same as standard version, use the standard instead)
...
- changed yacy logo
- removed crawlOrder protocol (unused)
- removed file index in kelondroFlex (will not work, it takes too long to maintain)
- fixed remoted crawl for clusters (now denies remote crawls from peers outside cluster)
- 0.562
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4317 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
b9dd597e97
- einem Komma folgende Leerzeichen bei der Eingabe von Tags werden gelöscht
...
- Anpassungen für die Auswahlbox-Option "selected"
- Einschränkung der Tagwolke aus Tag-Selektion
- Rundung von font-size auf zwei Nachkommastellen
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4315 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
ff16a6efc8
- Auswahlbox um die Option "selected" ergänzt
...
- in der Auswahlbox vale von #[tag]# auf #[name]# geändert (case sensitive)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4312 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ecd7f8ba4e
- added NEAR operator (must be written in UPPERCASE in search query)
...
- more generics
- removed unused commons classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4310 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
89f48bae55
*) if new tag is chosen, bookmark list will be updated automaticly if JavaScript is enabled (no click on "..." needed)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4308 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
214e37b6e3
added changes made by apfelmaennchen
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4307 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
1f199d688b
*) Christmas is over!
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4306 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
03e7782269
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4305 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f7c5ccedc7
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4301 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
88b2779787
added PerformanceMemory_p.xml
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4300 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
ae6d07bdb8
*) "Did you mean:" will only be displayed if the list of suggested URLs is not empty.
...
*) Removed <hr /> to make the "404 Unknown Host" error pag look like the other 404 error pages.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4298 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
df2a7a8ac8
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4295 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d8d955a7ff
start of next development cycle towards 0.57
...
happy xmas!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4291 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
d517e96714
last cleanup bits to serverDate before the release. only safe refactoring (method renaming) changes outside of serverDate.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4289 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
52dd015218
new release strategy: the standard release is now built the same way as the pro release
...
a new release type was added: 'embedded' which is the same as the current standard release was
this will not have any effect to the next release 0.56, which will still a pro-release on public download
the transition the the new release strategy must be done now to enable automatic update by the updated in future releases
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4287 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
1cb6e431a6
Replace the ISO8601 aka W3C datetime parser by one that supports every representation allowed by this standard, see http://www.w3.org/TR/NOTE-datetime
...
- useful expecially for sitemaps parsing, where this date format is used
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4286 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
33ee6745f6
more cleanup in serverDate
...
- remove direct accesses to SimpleDateFormat fields in serverDate and use the static parse... methods instead
- remove nowDate() as a Date doesn't store timezone information and a new Date() is always faster
- default formatter methods use a GMT timezone by default now, this is important for interchangability as some date formats we use don't include a timezone offset.
- continued renaming and rearanging (formatter) methods. all should follow the general naming scheme formatWHAT(...)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4285 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
3c30c2da75
more cleanup and API consistency changes, more to come...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4284 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
5aa8d72502
*) cleaned up code for better readability in Netbeans (tabs -> spaces)\n*) no functional changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4282 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
21b8d1b918
small cosmetic change for static fields in serverCore (special protocol ASCII entities) to improve readability
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4275 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
270d016d89
fix for missing anonymization in search profiling
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4274 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
b1e08d354c
repaired indexing after search snippet loading
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4268 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
5a80359b0e
new default remote favicon for search results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4266 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9e23acf2d6
introduced new 'authority' ranking property
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4265 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6a3a292015
- smoothed ymage font
...
- changed position of status banner
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4261 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
4331e52d1c
fixed too small peer number in banner
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4259 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
515e1bde6d
- fixed bug with constraint default
...
- 0.556
- default RAM for pro releases now 120MB (because pro will become default)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4258 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2954f96fae
- removed public peer info box on status page, this info can now be seen in the status banner
...
- added peer count to banner
- added some values to protected status box
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4257 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
aeb1cf83a6
- corrected banner link (relative now)
...
- changed color mode (replace) for banner
- changed default color (fits to default skin) of banner in status
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4255 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
5185acaf41
- reduced default search time
...
- this can be configured using the network definition file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4254 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
e22014dc83
some memory enhancements when generating and displaying ymage objects
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4253 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f243e338cf
implemented online caution also for local and remote search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4252 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6680634703
removed unnecessary functions
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4251 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
c57eb76b13
removed CMY color model from ymage classes and re-introduced RGB color model
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4249 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
b46bcaa5d8
changed method of profiling
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4248 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
low012
76cd6ed6f6
*) New methods to insert bitmaps that feature transparencies.
...
*) Logo background is transparent now. (Using pixel at (0,0) to determine which color is transparent. Too dirty?)
*) Logo is loaded through filesystem instead of HTTP now.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4247 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
be214e594f
- generalized ymage initialization options
...
- auto-adoption of performance memory graph to needed dimension
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4246 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
low012
72698fcd36
*) Banner features a logo now. It does not look nice, but at least it works. Banner is not finished yet.
...
Which path do I have to set for IMAGE (htroot/env/grafics/yacy.gi) if I want to load it through the file system and not via HTTP?
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4244 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago