orbiter
a06f7ddb33
more PMD recommendations
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6572 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
dd459281c8
applied code changes that are recommended by PMD
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6563 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
362b7a929b
added extensive memory protection logic to avoid out of memory errors that may be caused by the RowCollection memory allocation function
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6521 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
8281e29963
- more configuration for profiling graph (number of events)
...
- more logging for a shutdown: print reason and accessing IP into log
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6520 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
4a5100789f
replaced _all_ size() == 0 with isEmpty() and all size() > 0 with !isEmpty(). The isEmpty() method is much faster in some cases, especially when used to access badly balanced hashtables where an size() operation becomes a large iteration.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6510 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
491ba6a1ba
- some refactoring in workflow
...
- some refactoring in search process
- fixed image search for json and rss output
- search navigation on bottom of search result page in cases where there are more than 6 results on page
- fixes for number of displayed documents
- disabled pseudostemming
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6504 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
4c6312d103
enhanced image search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6489 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
2d8f3ee301
some performance hacks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6488 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
36fbfdcb21
more performance for remote search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6487 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
5c7b32a4fa
better performance for list api (blacklist transfer)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6486 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
5399d1e2bc
refactoring (reason: get more abstraction to use the blacklist class; for integration in other servlets)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6471 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
4431b9767e
added about 450 replacements for printStackTrace() methods to pipe such traces into the log at DATA/LOG/
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6458 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
a0e891c63d
- some redesign in UI menu structure to make room for new 'Content Integration' main menu containing import servlets for Wikimedia Dumps, phpbb3 forum imports and OAI-PMH imports
...
- extended the OAI-PMH test applet and integrated it into the menu. Does still not import OAI-PMH records, but shows that it is able to read and parse this data
- some redesign in ZURL storage: refactoring of access methods, better concurrency, less synchronization
- added a limitation to the LURL metadata database table cache to 20 million entries: this cache was until now not limited and only limited by the available RAM which may have caused a memory-leak-like behavior.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6440 6c8d7289-2bf4-0310-a012-ef5d649a1542
15 years ago
orbiter
5e8038ac4d
- refactoring of blacklists
...
- refactoring of event origin encoding
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6434 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
3528b970d6
- refactoring
...
- added new experimental (not-yet-working) image parser
- added new test image
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6431 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
b79f4f062f
refactoring of yacy documents and parsers: they depend now only on the kelondro classes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6426 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
5841ee83d3
refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6400 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
ce8dc575ca
refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6398 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
bea3b99aff
moved table and util classes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6397 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
1e4f8b56ed
accumulated classes from different packages into the new rwi package
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6394 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
4446acc8cd
moved kelondro order
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6392 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
f677d534b1
start of a really extensive refactoring which will produce a hierarchical package structure with the domain yacy.net as package root
...
- moved here the logging classes as part of the new net.yacy.kelondro package
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6391 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
735e2737e3
* added index segments
...
This is a major change in the organization of indexes.
Please consider a back-up of your data before you run this update.
All existing index files will be moved and renamed to a new position.
With this change, it will be possible to maintain different indexes for different purposes and it will be possible to have a distinction between DHT-in and DHT-out specific indexes. Tenants may also have their own index, and it may be possible to have histories and back-ups of indexes. This is just the beginning, many servlets must be adopted after this change, but all functions that had been there should still work.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6389 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
04a548a1e3
- temporary integrated the transferURL servlet as static class instead as a class that is called using reflection to investigate the OOM problems in that class
...
- fixes for numerous other problems
- removed dead code
- resdesign of the strings-method, which produces now less memory overhead and may help to prevent OOMs
- another fix for the deadlock problem in SplitTable
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6373 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
033554dc12
more logging in tranferURL to find OOM bug. See also
...
http://forum.yacy-websuche.de/viewtopic.php?p=17361#p17361
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6317 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
847c3027ff
added
...
- a time-out of 10 seconds
- and a clear-on-error
in yacyui-portalsearch, to make the loading bar disappear when nothing is found.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6289 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
3ebb228ea1
added smaller icon for widget
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6271 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
e7736d9c8d
more refactoring: made all variables in SearchEvent private
...
to prepare splitting of the class into two parts: local and remote search
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6265 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d8ca6e6bf1
more refactoring for search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6263 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
72ac5bd80f
refactoring of search process.
...
this is the beginning of some architecture changes that will hopefully bring some more stability, speed and transparency to the search process.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6260 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
1d8d51075c
refactoring:
...
- removed the plasma package. The name of that package came from a very early pre-version of YaCy, even before YaCy was named AnomicHTTPProxy. The Proxy project introduced search for cache contents using class files that had been developed during the plasma project. Information from 2002 about plasma can be found here:
http://web.archive.org/web/20020802110827/http://anomic.de/AnomicPlasma/index.html
We stil have one class that comes mostly unchanged from the plasma project, the Condenser class. But this is now part of the document package and all other classes in the plasma package can be assigned to other packages.
- cleaned up the http package: better structure of that class and clean isolation of server and client classes. The old HTCache becomes part of the client sub-package of http.
- because the plasmaSwitchboard is now part of the search package all servlets had to be touched to declare a different package source.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6232 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
5bb8074150
removed the indexing queue. This queue was superfluous since the introduction of the blocking queues last year, where documents are parsed, analysed and stored in the index with concurrency.
...
- The indexing queue was a historic data structure that was introduced at the very beginning at the project as a part of the switchboard organisation object structure. Without the indexing queue the switchboard queue becomes also superfluous. It has been removed as well.
- Removing the switchboard queue requires that all servlets are called without a opaque generic ('<?>'). That caused that all serlets had to be modified.
- Many servlets displayed the indexing queue or the size of that queue. In the past months the indexer was so fast that mostly the indexing queue appeared empty, so there was no use of it any more. Because the queue has been removed, the display in the servlets had also to be removed.
- The surrogate work task had been a part of the indexing queue control structure. Without the indexing queue the surrogates needed its own task management. That has been integrated here.
- Because the indexing queue had a special queue entry object and properties attached to this object, the propterties had to be moved to the queue entry object which is part of the new indexing queue withing the blocking queue, the Response Object. That object has now also the new properties of the removed indexing queue entry object.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6225 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
ca72ed7526
-removed superfluous crawl cache
...
-refactoring of crawler classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6221 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
8931c8d6b4
improvments to debianpackage:
...
* autoupdate completely disabled, display hint
* restart-button in interface works!
* moved all build-Variables to yacyBuildProperties
* fixed some warnings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6195 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
0e8647d62f
refactoring of search classes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6184 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
dafffd0153
refactoring of parsers and document processing
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6182 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
ba7905aaa8
PortalSearch:
...
- removed buttons
- auto load on scroll
- some small fixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6178 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
154bbc3364
code cleanup: call of static methods directly to the class
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6155 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
222850414e
simplification of the code: removed unused classes, methods and variables
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6154 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
d69d89caed
portalsearch: better navigator call href='javascript:...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6142 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
477a4e14f9
updated styles
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6141 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
0a38dd41b3
replacing styles
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6140 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
565230d2a0
another atempt to fix the widget on linuxtag.de
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6139 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
f92daf9cc5
fixed the "1 to 10 of 10" bug in portalsearch for less than 10 results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6138 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
e51ba46b8a
css fix for forum search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6137 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
0923f20993
font-size fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6136 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
edef81b41d
again a css fix for portalsearch :-(
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6135 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
32d0ee964f
more css fixes ;-)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6134 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
cfd3d672a7
portalsearch css fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6133 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
a71bb7178d
small fix for portalsearch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6132 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
121728643b
- css fix for navigators
...
- maybe this fixes the display problems on linuxtag.de
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6129 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
3164d9a205
small fix for favicons
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6124 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
b6058a7db1
yacyui-portalsearch:
...
- more bug fixes
- moved from faviconize to YaCy's favicons
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6122 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
57af311627
fix for wrong urls in navigator when a tenant is used
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6119 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
01853ce849
removed "illegal character"
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6117 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
f2db0d248b
fix for multi-word search (makes a replace-all)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6113 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
7fcffdcb3c
- yacyui-portalsearch: fix for multiple search terms
...
- http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209#p16015
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6112 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
f091ad3e23
- hopefully a fix for the 'koblenz'-bug
...
- http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209#p16005
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6110 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
d268bb5108
yacyui-portalsearch: auto open navigator sidebar
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6107 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
a22103560c
yacyui-portalsearch waits with execution until all svripts have been loaded. It checks the load status every 200ms!
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6106 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
49955cc7b9
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209&p=15984#p15984
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6104 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
2bb020a7a5
yacyui-portalsearch: small improvement to navigators
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6101 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
fee88d5fa3
maybe this fixes: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2209#p15967
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6100 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
be1c7ddc64
refactoring of search classes -- moved Ranking Profile to search package
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6086 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
ce1adf9955
serialized all logging using concurrency:
...
high-performance search query situations as seen in yacy-metager integration showed deadlock situation caused by synchronization effects inside of sun.java code. It appears that the logger is not completely safe against deadlock situations in concurrent calls of the logger. One possible solution would be a outside-synchronization with 'synchronized' statements, but that would further apply blocking on all high-efficient methods that call the logger. It is much better to do a non-blocking hand-over of logging lines and work off log entries with a concurrent log writer. This also disconnects IO operations from logging, which can also cause IO operation when a log is written to a file. This commit not only moves the logger from kelondro to yacy.logging, it also inserts the concurrency methods to realize non-blocking logging.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6078 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
bc6dd8194b
refactoring: moved search query class to new search package
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6075 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
945777aa80
replaced rwi term counting method by one that computes the maximum of the blobs that contibute to the RWI. An addition of the blob sizes is wrong/incorrect and does not reflect the real size. Truncation the size operation to the maximum of all blobs is also incorrect, but not as wrong as the sum of all blob sizes wich double-counts many rwi entries.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6064 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
55ef9ae12a
small fix for last post
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6054 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
36dc9b09ac
- partial update to jquery-1.3.2
...
- partial update to jquery-ui-1.7.2
- yacyportalsearch fixed sidebar for navigators
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6053 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
5a7dec880e
- some improvements for: http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p15668
...
- portalsearch: introduced yconf.load_js and yconf.load_css
- yacysearch.html still having problems with focus after sidebar is loaded
- yacysearchtrailer.json seems not to be valid json for ?nav=all
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6046 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
e0b3984805
added navigation keys for site and author facets to remote search interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6038 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
27fa6a66ad
- completed the author navigation
...
- removed some unused variables
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6037 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
c079b18ee7
- refactoring of IntegerHandleIndex and LongHandleIndex: both classes had been merged into the new HandleMap class, which handles (key<byte[]>,n-byte-long) pairs with arbitraty key and value length. This will be useful to get a memory-enhanced/minimized database table indexing.
...
- added a analysis method that counts bytes that could be saved in case the new HandleMap can be applied in the most efficient way. Look for the log messages beginning with "HeapReader saturation": in most cases we could save about 30% RAM!
- removed the old FlexTable database structure. It was not used any more.
- removed memory statistics in PerformanceMemory about flex tables and node caches (node caches were used by Tree Tables, which are also not used any more)
- add a stub for a steering of navigation functions. That should help to switch off naviagtion computation in cases where it is not demanded by a client
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6034 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
15fad767c0
some refactoring of topic generation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6018 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
ab06a6edd2
renamed topwords to topics and enhanced computation methods of topics
...
topics will now only be computed using the document title, not the document url,
because the host navigator is now responsible for statistical effects of urls.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6011 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
0d44a6d503
- yacy portalsearch experiments with navigation in sidebar (topwords & domains)
...
- not yet functional ...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6009 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
3ca1f109c4
added more jquery themes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6005 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
8fe69da2bb
- some fixes for prev. post
...
- better resizing and dragging
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6000 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
0eb3bffe97
- added 'drawer' (sidebar) for future navigational items to yacyui-portalsearch.js
...
- http://forum.yacy-websuche.de/viewtopic.php?f=9&t=1904#p15311
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5999 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
3d5f2ff544
- added new servlets to support search portal administrators for the integration of yacy search fields in their web pages
...
- moved some servlets from here to there..
- changed menu structure
- removed yacyui-portaltest.html which contained an example for the live search which is now integrated on all pages in yacy. The code snippet example from that page is integrated into the ConfigLiveSearch.html servlet
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5994 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
88426912ad
more refactoring to make the segment object easier to use and to be prepared to integrate author navigation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5992 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
99bf0b8e41
refactoring of plasmaWordIndex:
...
divided that class into three parts:
- the peers object is now hosted by the plasmaSwitchboard
- the crawler elements are now in a new class, crawler.CrawlerSwitchboard
- the index elements are core of the new segment data structure, which is a bundle of different indexes for the full text and (in the future) navigation indexes and the metadata store. The new class is now in kelondro.text.Segment
The refactoring is inspired by the roadmap to create index segments, the option to host different indexes on one peer.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5990 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
fec6f9054f
some refactoring of search methods
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5988 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
63a0255166
- refactoring: added new content package, which will contain connector classes for different types of data sources to import texts into the YaCy index
...
- refactoring: migrated data objects for the new connector classes
- added a DAO interface class to specify an abstract interface for database retrieval connector methods
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5977 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
492165338d
small addition for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5917 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
ac3139a1fd
fix for live-search positioning in header.template
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5915 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
acfd79ab4a
yacyui-portalsearch: added keyboard controlls
...
ESC: close window
PageDown: next search result page
PageUp: prev. page
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5911 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
f490eab6ba
yacyui-portalsearch: clear input on window close
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5910 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d3f8aa5a2a
set of small fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5903 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
84518710d0
small fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5901 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
63097513ae
maybe this smoothens the timing problems yacyui-portalsearch.js a little bit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5900 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
d079d6dfdb
small changes in surrogate reader, wiki code and portal test
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5894 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
07f09742bb
set of small fixes and comments
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5893 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
50e96ee894
- moved live search window in yacy to different location
...
- changed div id for live seach from 'yacy' to 'yacylivesearch'
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5889 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
0b4e4bbddd
fixed css interferance for previous posts
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5887 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
ed4fb3bf75
small fix to portal search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5886 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
4cf8b08eec
Portal Search:
...
- request: http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762&start=50#p14350
- window closes for empty query
- example for fancy input field
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5884 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
42d936288e
small update for RichClient LogViewer
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5883 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
6f5ea7b1a8
small fix for previous post
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5879 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
2eabd989ce
- added a log viewer to RichClient (alpha version, very slow)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5878 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
557c2a32a3
small fix for yacyui-portalsearch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5876 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
b4539a61dd
some more documentation for yacyui-portaltest.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5875 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
64ce9da60f
- new yconf parameter global
...
- see http://forum.yacy-websuche.de/posting.php?mode=quote&f=9&p=14207#pr14207
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5873 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
9325198c42
hopefully a fix for http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762#p14305
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5871 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
675f350d18
YaCy Portal Search Widget
...
- see http://localhost:8080/yacy/ui/yacyui-portaltest.html
- two new parameters (logo and link) for yconf as requested at http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762#p14101
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5869 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
daea87d436
do not accept dht from bad versions
...
delete bad hashes on receive
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5852 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
dfb96ecb72
more fixes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5844 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
fa3adbbfc6
added domain checks to surrogate reader and RWI transfer receiver to prevent spaming using surrogates
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5837 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
b15b059c0d
fix for latest commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5813 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
c8624903c6
full redesign of index access data model:
...
terms (words) are not any more retrieved by their word hash string, but by a byte[] containing the word hash.
this has strong advantages when RWIs are sorted in the ReferenceContainer Cache and compared with the sun.java TreeMap method, which needed getBytes() and new String() transformations before.
Many thousands of such conversions are now omitted every second, which increases the indexing speed by a factor of two.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5812 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
89ec3acb3e
- full abstraction of index content type: the kelondro full text index may now also contain indexes about other content than text, i.e. navigation indexes or reverse linking indexes.
...
- during index joins all word positions are maintained: better ranking for word distance possible; exact phrase match can be implemented soundly
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5804 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
44e01afa5b
- refactoring
...
- a little bit more abstraction
- new interfaces for index abstraction
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5783 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
c2359f20dd
refactoring: better abstraction of reference and metadata prototypes.
...
This is a preparation to introduce other index tables as used now only for reverse text indexes. Next application of the reverse index is a citation index.
Moved to version 0.74
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5777 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
7ba078daa1
- added fast site-operator
...
- refactoring merge into BLOBArray
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5770 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
eb65990f85
small fix for opera in yacyui-portalsearch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5751 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
695c420bcd
small fix for yacyui-portalsearch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5750 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
95885a263a
- added default properies to yacyui-portalsearch
...
- see http://localhost.8080/yacy/ui/yacyui-portaltest.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5749 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
c001a020a9
- small modifications to yacyui-portalsearch
...
- see http://forum.yacy-websuche.de/viewtopic.php?f=15&t=1762&p=13459#p13459
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5748 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
34a825f90d
small fix for yacyui-portaltest.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5746 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
9f9d7f875d
small fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5745 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
453f3aaa94
RichClient: further clean-up
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5744 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
e888c9a934
RichClient:
...
- renamed base theme to start theme
- reoved all but start theme
- additional themes can be downloaded from http://jquery-ui.googlecode.com/files/jquery-ui-themes-1.7.zip
- or a custom theme can be generated at http://jqueryui.com/themeroller/
- themes are installed into DATA/LOCALE/htroot/yacy/ui/css/themes
- update for RichClient theme selection will follow soon
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5743 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
42c5f930c8
reverted an accidental commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5742 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
b5e6232f8d
small correction of font-size for portal search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5741 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
7425c6c3ca
added an ajax loading graph to portal search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5740 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
a975ae4a7e
Added YaCy portal search: http://localhost:8080/yacy/ui/yacyui-portaltest.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5739 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
b57a1820bd
small fix for jquery-faviconize-1.0.js to handle https properly
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5738 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
075b58a0a9
minor fixes for RichClient search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5737 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
83792d9233
more refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5722 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
474aac65af
more refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5719 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
209f25f5f5
refactoring to integrate indexCell data structures
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5718 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
7f67238f8b
refactoring of plasmaWordIndex: less methods in the class, separated the index to CachedIndexCollection
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5710 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
14a1c33823
refactoring of wordIndex class
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5709 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
e2e7949feb
replaced old PPM computation with a better one that simply sums up events that had been stored in the profiling table.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5706 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
9b6fac4a82
RichClient: better handling for small screens/windows
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5681 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
f0947a20a8
- RichClient: increased ajax timeout to 10 sek.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5678 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
e73ac67f7e
- for testing JsonP cross domain request I added apfelmaennchen-JsonP as search peer to RichClient
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5677 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
f7fd3d30c2
- various changes to RichClient
...
- improved search stability
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5675 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
efcd95dc37
simplification of (internal) query process / refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5671 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
aa44d9bad9
more refactoring of kelondro.text / deleted de.anomic.index
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5664 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
6ffc6e3389
more refactoring of indexer and kelondro classes;
...
- integrating the indexer into kelondro as package 'text'
- renaming of classes in kelondro.index
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5663 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
404bc21da9
simplification of (internal) query process / refactoring
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5662 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
76ef5f0f14
refactoring of index package: better names for the classes (to be continued)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5661 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
72cc1d3a6c
YaCy-UI: fix for query string handling in yacyuisearch.html: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1869#p12878
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5645 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
784a7bb7fd
YaCy-UI: small fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5644 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
aa13d03b99
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=1874#p12914
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5643 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
4693495bbe
added sru-compatibility to yacyuisearch ('query' instead of 'search')
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5637 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
54c7698219
YaCy-UI: some clean up of base.css
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5635 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
5d806623d5
YaCy-UI:
...
- fix for folders
- first experiments with topwords
- first experiments with bookmark tag folder
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5634 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
bd6a3083c5
YaCy-UI Widget: added a target='_blank' to search results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5632 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago