orbiter
bd63999801
- faster search: using different data structures that avoid multiplr calculations
...
- no more table copy for error-eco table
- optional table copy for lurl-entries
- more abstractions (less single constant strings)
- better logging (using host names instead of ips)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4459 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
8358652fa9
some small changes to blog
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4457 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
159aaf8889
re-introduced global search limitation when index receive is switched off
...
this was necessary because othervise robinson peers did also global searches, which cannot be a wanted effect
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4456 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
a8d336c379
undo 4448 (no bug)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4455 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
d1758eb17d
mistake corrected
...
cleanup
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4454 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
9f69b1f08f
small change (2)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4449 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
5ac71729d8
small change
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4448 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
borg-0300
85a82950e0
seedDB helpers
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4447 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ebe07b736c
added stub for new search page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4446 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
efd5807a7c
- some renaming of variables to support DC
...
- initial 120mb RAM for fresh peers
- release 0.57
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4445 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
40a0591942
Fixed numberbug in Blog, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=639 . This wont fix existing Blogentrys (comes later).
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4443 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
df548f444f
one more NPE patch for a search item case
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4440 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ff6b69b37e
fix for NPE in access tracker
...
fix for NPE in word index
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4439 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3c7b94c119
- fix for online caution delay settings, see
...
http://forum.yacy-websuche.de/viewtopic.php?f=6&t=738&p=4723#p4723
- removed remote search limitation for non-dht-peers according to discussion in
http://forum.yacy-websuche.de/viewtopic.php?f=15&t=793&hilit=&p=5277#p5277
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4438 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
a981cd5ab7
ignore folder tags...on request of daburna
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4436 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a1e9e6e2e6
fix for search result page navigation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4431 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
7404256997
- no more search time-out!
...
- fixed a bug with last commit
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4430 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
cd3e0d6f03
tried to fix another eco bug
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4429 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
89169d54fd
fixed search result preparation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4427 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
7c29bc4a87
#updated German languagefile
...
+set spacer between topwords
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4426 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a8a5df4a51
- more dublin core naming of page metadata
...
- better presentation of result counters in search results
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4420 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9d693ee635
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4415 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
0f5c4abaca
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4414 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
974fea7933
added term-frequency ranking
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4413 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
1a296af6ff
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4412 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
4a80902081
- added ViewProfile as rdf in foaf syntax
...
- added link to rdf and vCard version on html page
- can be seen on http://localhost:8080/ViewProfile.html?hash=localhash
- more generics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4411 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
1b930a6702
#small corrections
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4409 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
f5ab90d964
added auto reload graph option by Lotus
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4407 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
d3ce9ebffe
added tooltips to folder tree
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4406 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
eb6bdf49c1
fixed import Netscape Bookmarks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4403 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
cb91cc5c7c
fixed import Netscape Bookmarks
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4402 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2485681002
added termination control for RotateIterator
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4399 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
15397298dc
- refactoring of indexControlRWIs: moved statics to own class; better Dublin Core naming
...
- fix for http://forum.yacy-websuche.de/viewtopic.php?f=5&t=759&hilit=&p=4866#p4866
- some bugfixes in EcoTable according remove method
- switched more tables to Eco: crawl Profiles, htcache, seeddb, newsdb
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4397 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
2dc994515d
fixed a typo
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4396 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
98e0cd7b87
fixed export bookmark link
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4395 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
d59f9e0c17
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4394 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
7b400756c4
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4393 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
30bf4bdc48
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4392 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
b32b025d4b
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4391 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
29146ff855
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4390 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
6dc319fc32
UTF-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4389 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
3afdcd0d59
fixed problem with utf-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4388 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
13668830b7
fixed problems with utf-8
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4387 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
34e5422675
adjusted code for bookmarksDB.getFolderList()
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4386 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
aa53a46937
adjusted code for getFolderList() and cleanTagsString()
...
added input for folders in add/edit bookmark
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4385 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
eebc688f37
moved Login link to submenu
...
added Folders to add/edit bookmark form
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4384 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
6f9f821481
added XBEL Export for YaCy Bookmarks. Tags are strored as
...
<metadata owner="Mozilla" ShortcutURL="tag1,tag2"/>
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4381 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
4e70dff8cf
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4379 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
41a3ff8ccc
*) removed unused imports
...
*) some generics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4374 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
c0fbab9cca
*) heading, trailing and double commas are removed since they are unnecessary
...
*) trailing and double slashs in paths are removed, they are not only ugly, but also caused infinite loops
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4373 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
089faf1a00
*) added login link at bottom of page
...
*) empty tags will not be displayed any longer
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4372 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
634430c48a
- more logging
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4368 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
d288987a93
replaced isEmpty() with equals("")
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4367 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
a870ac32b8
reorganized code and added folders; this update might have overwritten latest changes by orbiter - sorry!
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4364 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
62a5df5bfc
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4363 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
7aa94f17da
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4362 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
373fface89
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4361 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
f319bbe4c8
adjustments for folder tree
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4360 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6eb8321cb0
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=752&p=4815#p4815
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4359 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
4c631d912e
added folder view; limited tag view to top25
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4356 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
e68b133b35
added JavaScript for folder tree view
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4355 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
85dc62c16f
refactoring: more dublin core - compliant naming
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4354 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
efd0b8371a
- added parsing of Dublin Core - compliant metadata (see RFC 5013 and ISO 15836) to html parser
...
- refactoring of plasmaParserDocument to use Dublin Core - compatible property names
- redesign of url handling in parser and condenser (less String-to-yacyURL conversion)
- more generics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4352 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9eb746863d
interface enhancements for eco records memory statistics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4348 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f6cfb97b7f
added a test servlet (to be used to analyse the remote crawl xml bug)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4344 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f4e9ff6ce9
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4343 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
45339c3db5
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4341 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
94f21d9403
activated new kelondroEcoTable file structure.
...
This data structure replaces almost all files in the PLASMA directory
also the collection.index and the LURL-db will be created as Eco-DB, if it does not exist before
existing Flex-databases will be used as they are (the is no data lost)
If you want to force the creation of a Eco-collection.index, simply delete the old index.
The Eco file system will only be used if there is enough memory.
The collection.index RAM limit is 200MB, if you have less, a flex-Table is createt.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4340 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
739f35d389
*) added previous/next links to blog (in case blog has more entries than get displayed on one page)
...
The blog still has a major problem: entries are displayed in random(?) order if there are several entries in the blog
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4339 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
71a67436ac
*) fix for last commit
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4329 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
352f733a86
*) added "previous" and "next" links that make it possible to navigate through lists of comments (needed if there are more than 10 comments to one postig)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4328 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
2018f33e7b
*) it was possible to post comments even if they were turned of if one knew the ID of a posting in the blog
...
*) Login link was displayed even if user was already logged in
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4327 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f3f02b08ec
no distinction between standard and pro releases in auto-updater
...
this did not work in 0.56 main (but should).
Therefore it will be necessery to provide a hand-made 'virtual pro' (just renaming) release 0.57
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4326 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a6ca3b51be
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4322 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a5054c038d
- added large number of generics
...
- redesign of ordering structures in kelondro (old did not work with strict generics)
- 50% IO reduction during read access on kelondroFlex (ommiting of read on index table)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4320 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
eff372e20c
- Fixed alignment of heading 'YaCy -'
...
- Changed identation of html-file for better readability, added some comments
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4319 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
8bb21e98f4
div.bookmarkList angepasst - rechter Rand zur TagList
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4318 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
71bcf02d3a
- removed pro-version (is the same as standard version, use the standard instead)
...
- changed yacy logo
- removed crawlOrder protocol (unused)
- removed file index in kelondroFlex (will not work, it takes too long to maintain)
- fixed remoted crawl for clusters (now denies remote crawls from peers outside cluster)
- 0.562
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4317 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
b9dd597e97
- einem Komma folgende Leerzeichen bei der Eingabe von Tags werden gelöscht
...
- Anpassungen für die Auswahlbox-Option "selected"
- Einschränkung der Tagwolke aus Tag-Selektion
- Rundung von font-size auf zwei Nachkommastellen
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4315 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
apfelmaennchen
ff16a6efc8
- Auswahlbox um die Option "selected" ergänzt
...
- in der Auswahlbox vale von #[tag]# auf #[name]# geändert (case sensitive)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4312 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ecd7f8ba4e
- added NEAR operator (must be written in UPPERCASE in search query)
...
- more generics
- removed unused commons classes
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4310 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
89f48bae55
*) if new tag is chosen, bookmark list will be updated automaticly if JavaScript is enabled (no click on "..." needed)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4308 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
214e37b6e3
added changes made by apfelmaennchen
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4307 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
1f199d688b
*) Christmas is over!
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4306 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
03e7782269
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4305 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f7c5ccedc7
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4301 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
lulabad
88b2779787
added PerformanceMemory_p.xml
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4300 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
ae6d07bdb8
*) "Did you mean:" will only be displayed if the list of suggested URLs is not empty.
...
*) Removed <hr /> to make the "404 Unknown Host" error pag look like the other 404 error pages.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4298 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
df2a7a8ac8
more generics
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4295 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d8d955a7ff
start of next development cycle towards 0.57
...
happy xmas!
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4291 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
d517e96714
last cleanup bits to serverDate before the release. only safe refactoring (method renaming) changes outside of serverDate.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4289 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
52dd015218
new release strategy: the standard release is now built the same way as the pro release
...
a new release type was added: 'embedded' which is the same as the current standard release was
this will not have any effect to the next release 0.56, which will still a pro-release on public download
the transition the the new release strategy must be done now to enable automatic update by the updated in future releases
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4287 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
1cb6e431a6
Replace the ISO8601 aka W3C datetime parser by one that supports every representation allowed by this standard, see http://www.w3.org/TR/NOTE-datetime
...
- useful expecially for sitemaps parsing, where this date format is used
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4286 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
33ee6745f6
more cleanup in serverDate
...
- remove direct accesses to SimpleDateFormat fields in serverDate and use the static parse... methods instead
- remove nowDate() as a Date doesn't store timezone information and a new Date() is always faster
- default formatter methods use a GMT timezone by default now, this is important for interchangability as some date formats we use don't include a timezone offset.
- continued renaming and rearanging (formatter) methods. all should follow the general naming scheme formatWHAT(...)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4285 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
3c30c2da75
more cleanup and API consistency changes, more to come...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4284 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
5aa8d72502
*) cleaned up code for better readability in Netbeans (tabs -> spaces)\n*) no functional changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4282 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
21b8d1b918
small cosmetic change for static fields in serverCore (special protocol ASCII entities) to improve readability
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4275 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
270d016d89
fix for missing anonymization in search profiling
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4274 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
b1e08d354c
repaired indexing after search snippet loading
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4268 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
5a80359b0e
new default remote favicon for search results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4266 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9e23acf2d6
introduced new 'authority' ranking property
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4265 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6a3a292015
- smoothed ymage font
...
- changed position of status banner
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4261 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
4331e52d1c
fixed too small peer number in banner
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4259 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
515e1bde6d
- fixed bug with constraint default
...
- 0.556
- default RAM for pro releases now 120MB (because pro will become default)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4258 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2954f96fae
- removed public peer info box on status page, this info can now be seen in the status banner
...
- added peer count to banner
- added some values to protected status box
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4257 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
aeb1cf83a6
- corrected banner link (relative now)
...
- changed color mode (replace) for banner
- changed default color (fits to default skin) of banner in status
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4255 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
5185acaf41
- reduced default search time
...
- this can be configured using the network definition file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4254 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
e22014dc83
some memory enhancements when generating and displaying ymage objects
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4253 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f243e338cf
implemented online caution also for local and remote search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4252 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6680634703
removed unnecessary functions
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4251 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
c57eb76b13
removed CMY color model from ymage classes and re-introduced RGB color model
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4249 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
b46bcaa5d8
changed method of profiling
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4248 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
76cd6ed6f6
*) New methods to insert bitmaps that feature transparencies.
...
*) Logo background is transparent now. (Using pixel at (0,0) to determine which color is transparent. Too dirty?)
*) Logo is loaded through filesystem instead of HTTP now.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4247 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
be214e594f
- generalized ymage initialization options
...
- auto-adoption of performance memory graph to needed dimension
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4246 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
72698fcd36
*) Banner features a logo now. It does not look nice, but at least it works. Banner is not finished yet.
...
Which path do I have to set for IMAGE (htroot/env/grafics/yacy.gi) if I want to load it through the file system and not via HTTP?
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4244 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3f848e282b
PerformanceMemory_p now does a automatic update of memory graph every second
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4242 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
aefb3f7765
added memory graph picture to PerformanceMemory_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4241 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ea81d97cfc
fix for bad full domain crawl depth adoption
...
(maximum depth is 8, because higher depth will cause that remote crawls do not work)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4240 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f645408ae9
added url retrieve option to uls.xml interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4239 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
cc20870267
fix for constraint handover problem:
...
old yacy versions set a catchall-constraint if no constraint is given, but the
new versions expect a null-constraint.
see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=565&hilit=
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4238 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9b0ae4b989
added referrer to remote crawl url list
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4236 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d59c1a7936
removed test data
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4233 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
89b9b2b02a
redesigned remote crawl process:
...
- instead of pushing urls to other peers, the urls are actively pulled
by the peer that wants to do a remote crawl
- the remote crawl push process had been removed
- a process that adds urls from remote peers had been added
- the server-side interface for providing 'limit'-urls exists since 0.55 and works with this version
- the list-interface had been removed
- servlets using the list-interface had been removed (this implementation did not properly manage double-check)
- changes in configuration file to support new pull-process
- fixed a bug in crawl balancer (status was not saved/closed properly)
- the yacy/urls-protocol was extended to support different networks/clusters
- many interface-adoptions to new stack counters
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4232 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2fcd18a972
- fixed bad behaviour of search event worker processes
...
- fixed export of url lists in xml
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4229 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
445c0b5333
added domain list extraction and html export format
...
to URL administration menu http://localhost:8080/IndexControlURLs_p.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4228 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bf6952abe7
- added url export to http://localhost:8080/IndexControlURLs_p.html
...
- removed command-line option to export urls
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4226 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
edba2b7bcc
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=543
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4224 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
c48b73cda2
redesign of ranking data structure
...
- the index administration now uses the same code base for url selection and collection
as the search interface. The index administration is therefore a good test environment for
ranking order control
- removed old postsorting-algorithms, will be replaced with new one
- fixed many bugs occurred before during ranking; especially the contraint filtering method
removed too many links
- fixed media search flags; had been attached to too many urls. The effect should be a better
pre-sorting before media load within snippet fetch
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4223 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6f1308da2f
- some enhancements to IndexControlURLs (shows more links, connects referrer to another query)
...
- some refactoring to search process
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4222 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bf9a9e4e5e
fix for NPE in IndexControlRWIs_p.java
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4221 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
c527969185
- enhanced monitoring of ranking parameters
...
for details, please try http://localhost:8080/IndexControlRWIs_p.html
- fixed computation of ranking ordering in some cases
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4220 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bd5673efbe
added cleaning of search event before opening the index administration
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4219 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
55da871211
preparations for better ranking: better debugging of index properties
...
to do this, the index administration interface was extended.
It is now possible to select parts of a index.
See properties shown in interface after a word search for details.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4218 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
383dc815d2
*) fix for commit 4212
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4217 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3491531cea
- fixed 'appears in url' flag in index generation
...
- extended index administration page, shows some properties to the web links now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4216 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
19176e12e2
-corrected typo made in 4213
...
-updated translation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4215 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ca4ca79eba
removed wrong hints to installation page.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4213 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
a01c42575d
*) 404 error pages will be displayed with correct CSS and favicon now ( http://forum.yacy-websuche.de/viewtopic.php?t=482 )
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4212 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bc2368e907
fix for problem with remote crawl referrers
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4210 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2e91b724ad
fix for yacysearch/rss-feed bug
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4203 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
0eb60cfe6f
better handling of seed properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4199 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6eaa5a0e64
enhanced local search speed. The ranking process is now 6 times faster that before.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4197 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
425e4ead66
Allow absolute paths in configuration settings.
...
- before absolute paths would be expanded incorrectly, e.g.: fooPath=/a/b/c would become /path/to/yacy/root/a/b/c. Now you can put nearly every dynamically generated data with a configurable path to a location outside of yacys root dir without having to use symlinks (probably good for third party distribution packaging).
- abstractServerSwitch.getConfigPath(setting, default) returns a File instance, either with an absolute path or relative to the applications root path.
- exceptions (hardcoded):
DATA/LOG/yacy.logging
DATA/SETTINGS/httpProxy.conf
DATA/SETTINGS/user.db
TODO: all of these are the global configuration files and they should probably be put into _one_ command line configurable settings path, so it would be possible to package them in /etc/ for example.
- add missing workPath to yacy.init (it was used in code, but there was no default in the file)
- fix broken skinPath (was skinsPath in yacy.init but skinsPath in the code) + a few other broken config reading caused by typos.
- replaced path setting names and their default values with the related static fields in plasmaSwitchboard where not already done/existing
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4196 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
794d296129
project link update
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4193 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ccbfb15b6b
enhancement to crawl stacker enqueue order
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4192 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
93905e5c7b
fix for show-more bug
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4191 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
55c87b3b12
changed behavior of crawl stacker
...
- final flush only when tabletype = RAM
- prestacker (dns prefetch) only if tabletype = RAM and busytime <= 100
- number of maximun entries in stacker is configurable in yacy.init (stacker.slots)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4186 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
87b297b4d2
update of link to english forum
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4182 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
a31b9097a4
preparations for mass remote crawls:
...
two main changes must be implemented to enable mass remote crawls:
- shift control of robots.txt to crawl queue (away from stacker). This is necessary since remote
crawls can contain unchecked urls. Each peer must check the robots to prevent that it is misused
as crawl agent for unwanted file retrieval
- implement new index files that control double-check of remotely crawled urls
After removal of robots.txt checking from stacker threads, the multi-threading of this process is void.
Multithreading has been removed. Also the thread pools for the crawl threads had been removed, since
creation of these threads is not resource-consuming, for a detailed explanation see svn 4106
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4181 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
a718858e8b
seed.CCOUNT is interpreted as a double value not int
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4180 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago