orbiter
5bb8074150
removed the indexing queue. This queue was superfluous since the introduction of the blocking queues last year, where documents are parsed, analysed and stored in the index with concurrency.
...
- The indexing queue was a historic data structure that was introduced at the very beginning at the project as a part of the switchboard organisation object structure. Without the indexing queue the switchboard queue becomes also superfluous. It has been removed as well.
- Removing the switchboard queue requires that all servlets are called without a opaque generic ('<?>'). That caused that all serlets had to be modified.
- Many servlets displayed the indexing queue or the size of that queue. In the past months the indexer was so fast that mostly the indexing queue appeared empty, so there was no use of it any more. Because the queue has been removed, the display in the servlets had also to be removed.
- The surrogate work task had been a part of the indexing queue control structure. Without the indexing queue the surrogates needed its own task management. That has been integrated here.
- Because the indexing queue had a special queue entry object and properties attached to this object, the propterties had to be moved to the queue entry object which is part of the new indexing queue withing the blocking queue, the Response Object. That object has now also the new properties of the removed indexing queue entry object.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6225 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
b332dfad67
- inserted request object into response object which carries this now instead generating new objects
...
- fixed a problem with the crawler introduced in SVN 6216
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6222 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
ca72ed7526
-removed superfluous crawl cache
...
-refactoring of crawler classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6221 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
13c63f4082
a set of small fixes to crawling behaviour
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6216 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
b2263bc720
enhanced document type recognition
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6209 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
7d493cf8cc
moved parser configuration in separate servelet
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6207 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
3f113f38a8
removed unused imports
...
removed unused libs from eclipse class path
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6201 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
9f083bb6b2
check filetype before loading (no more mp4 loading)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6200 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
f814e0fa81
enable warnings and fix most of it
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6196 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
8931c8d6b4
improvments to debianpackage:
...
* autoupdate completely disabled, display hint
* restart-button in interface works!
* moved all build-Variables to yacyBuildProperties
* fixed some warnings
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6195 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
4b74ad0a46
fixed setting of parser configuration servlets
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6191 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
57a88d435b
redesign of parser mime type detection and parser steering
...
There is now a mime-blacklist instead of a mime-whitelist
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6190 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
21b8704fb4
refactoring of the ParserDispatcher and ParserConfig: resulted into Idiom, Parser and Classification classes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6188 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
8ca1f5d400
- some work to integrate the html parser the same way as the other parsers are integrated (not finished)
...
- added migration of code of settings pages (hmm.. does not work correctly yet, sorry)
- more refactoring
- removed more unused code
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6187 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
499723891d
removed all non-http daemons; they had not been used and may be a potential security risk.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6185 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
0e8647d62f
refactoring of search classes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6184 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
dafffd0153
refactoring of parsers and document processing
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6182 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
ba7905aaa8
PortalSearch:
...
- removed buttons
- auto load on scroll
- some small fixes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6178 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
ec2970cc76
higher dht distribution speed by default
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6168 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
995da28c73
all stack/heap files that had been stored in DATA/PLASMA are now stored in the network-specific QUEUES path
...
There is no migration. All crawls must be restarted.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6167 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
409538e17a
code cleanup and code simplifcation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6161 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
154bbc3364
code cleanup: call of static methods directly to the class
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6155 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
222850414e
simplification of the code: removed unused classes, methods and variables
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6154 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
9a674d8047
- After the removal of the Tree class some code simplifications are possible. This affects mostly the Records class, which can be refactored and the result of the refactoring results in a reduced number of classes.
...
- The EcoTable was renamed to Table.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6151 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
f1ori
7eb3bff5b3
* workaround for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=2220&hilit=#p16128
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6143 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
d69d89caed
portalsearch: better navigator call href='javascript:...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6142 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
477a4e14f9
updated styles
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6141 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
0a38dd41b3
replacing styles
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6140 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
565230d2a0
another atempt to fix the widget on linuxtag.de
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6139 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
f92daf9cc5
fixed the "1 to 10 of 10" bug in portalsearch for less than 10 results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6138 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
e51ba46b8a
css fix for forum search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6137 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
0923f20993
font-size fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6136 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
edef81b41d
again a css fix for portalsearch :-(
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6135 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
32d0ee964f
more css fixes ;-)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6134 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
cfd3d672a7
portalsearch css fix
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6133 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
a71bb7178d
small fix for portalsearch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6132 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
69b573a8ac
- next release cycle
...
- doku update for phpBB3
- added more files for search test scripts
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6130 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
121728643b
- css fix for navigators
...
- maybe this fixes the display problems on linuxtag.de
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6129 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
93c69fa1cb
- added hints to integrate a yacy search in phpBB3
...
- added also a phpBB3 crawl start with optimized crawl attributes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6126 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
99fa265e1d
fix for search bug caused by tenant patch
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6125 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
3164d9a205
small fix for favicons
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6124 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
edcb78dcb6
updated documentation / removed faviconize
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6123 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
apfelmaennchen
b6058a7db1
yacyui-portalsearch:
...
- more bug fixes
- moved from faviconize to YaCy's favicons
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6122 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
96d4e9383a
added new jquer version in wiki search widget snippet
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6121 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
57af311627
fix for wrong urls in navigator when a tenant is used
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6119 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
01853ce849
removed "illegal character"
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6117 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
187ee4d06e
another IE fix (also same names in html and js)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6116 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
48051fef4b
another fix for IE
...
http://forum.yacy-websuche.de/viewtopic.php?p=16030#p16030
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6115 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
lotus
37c162053d
fix for IE & WatchCrawler (were same names in js and html)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6114 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter
f2db0d248b
fix for multi-word search (makes a replace-all)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6113 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago