orbiter
33ad0c8246
added a web structure computation and logging:
...
- all web page parsing operations will now increase a web structure file
- the file is computed in memory and dumped at shutdown-time to PLASMASB/webStructure.map in readable form (not a database)
- the file can be used externally to analyse the link structure of the crawled pages
- the web structure can also be retrieved using a xml-interface at http://localhost:8080/xml/webstructure.xml
- the short-term purpose is the computation of a link-graph image (before linuxtag!)
- a long-term purpose could be a decentralized computation of the citation rank
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3746 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
auron_x
cd3494a04c
*) hint for idle indexer only appears if indexer is idle now
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3744 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
karlchenofhell
baa9402b97
- wiki-parser is now configurable via the config setting wikiParser.class which holds the class-name for the parser to use
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3742 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
karlchenofhell
601fc7d1c5
- added source to J7Zip-modifed.jar and it's license (changelog is still to come)
...
- moved HTML-*replace-methods from wikiCode to de.anomic.data.htmlTools
- prepared use of different wiki parsers as suggested here: http://www.yacy-forum.de/viewtopic.php?p=34444#34444
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3741 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
b3f97b5c38
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3735 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
karlchenofhell
086239da36
- added servlet: remote crawler queue overview
...
- added servlet: crawl profile editor
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3731 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
4dc45d6e97
*) adding tags for skype
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3729 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
karlchenofhell
8ba81e0995
- added some comments (will get more in the near future)
...
- added missing <label> to the search field in Network.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3728 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
allo
eda8696e33
http://www.yacy-forum.de/viewtopic.php?p=35721
...
wrong startindex
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3727 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
(no author)
424146f027
more XHTML validation
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3710 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
auron_x
841e51e15e
*) addition to last commit (just commited html-changes)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3707 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
auron_x
15ad9ff32e
*) removed unneccessary debug-lines
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3706 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
85035dc319
addition to svn 3699: check send/receive if p2p-mode is activated
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3701 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
borg-0300
709b4c1905
added switches for the columns
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3700 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
auron_x
1d1685c588
*) added some JS to give more direct feedback
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3699 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
(no author)
0132fb6ea7
Status.html now more XHTML valid
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3694 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
139c59ebbd
- fixed dht selction problem: the seed tables used a wrong ordering
...
- cleaned some code
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3693 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
auron_x
c671d70b2e
*) added german translation for NetworkConfig
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3690 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
f3fee4d445
fix for http://www.yacy-forum.de/viewtopic.php?p=35322
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3689 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
c209ef5137
changed the icons again
...
- slightly different size of '!'
- differen colours of idea-icon
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3688 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
6e74adcb54
*) Bugfix for layout problem with hint boxes
...
See: http://www.yacy-forum.de/viewtopic.php?p=35316
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3687 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
low012
a50256aba2
*) removed surplus replacements of HTML
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3686 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
a3ecfe0a45
replaced failed-icon by new 'bad'-icon
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3680 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
ba6e91ed76
changed again the icons
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3679 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
03032f7d62
more tipps
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3678 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
b0cf009c16
- added an idea icon
...
- modified ok icon (was 64x62, now 64x64)
- replaced warning icon
- added size tags to warning image in configBasic
- replaced bad icon for hints on status page by new icons
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3677 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
dbe8eeba74
slightly enhanced the favicon
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3676 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
68f5d64ae6
replaced yacy logo by better version
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3675 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
7d9259e44d
*) Bugfix for umlaut problem
...
See: http://www.yacy-forum.de/viewtopic.php?t=3932
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3674 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
dca85b82ff
fix for wrong memory display
...
see http://www.yacy-forum.de/viewtopic.php?p=35239#35239
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3673 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
d6480dc670
fix for long transfer pauses
...
see http://www.yacy-forum.de/viewtopic.php?p=35243#35243
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3672 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
(no author)
b25bc6c36d
*) Status page now has button to install updates (1/2)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3670 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
0b5fc3c28c
*) moving date functions to serverDate class
...
*) Sitemap-parser
- logging added
- parsing of modDate added
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3667 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
theli
6f46245a51
*) Bookmarks: Ajax icon is displayed while loading title
...
*) First version of a sitemap parser added
- currently only autodetection of sitemap files is supported
*) DB-Import restructured
- pause/resume should work again now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3666 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
111ba9e359
- fixed some width problems in new status page
...
- fixed deadlock in dns cache
- added termination security for DHT peer selection
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3660 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
8005b532ad
moved message string from colums at the side of Status_p.html to main text field
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3651 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
158b652c17
redesign of status page:
...
- moved all information to columns at the right side
- long texts within the column will be removed in a second step, and will re-appear
as action items below the 'Welcome' header
- new usage hints will also appear below the Welcome header
- Peer news (in full sentences) will appear in separate column
- possibly some more grafics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3647 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
e0007b2764
fixed save button in confignetwork
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3643 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
9c41132569
re-implemented gc-button (has been lost somewhere)
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3639 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
dd44a1394f
disabled automatic performance setting change
...
- during crawl start
- each indexing cycle
- for delay values
- for short memory cycles
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3634 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
b9add5cf37
some bugfixes:
...
- dht iterator start point
- wordIndex synchronization
- surftipps url check
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3633 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
06b6e35484
fix for a null pointer exception if clusters are not defined
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3632 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
d4428947af
fix for http://www.yacy-forum.de/viewtopic.php?p=34962#34962
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3630 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
81844e85b2
- fixed more cluster routing problems
...
- fixed a problem in remote search when balancer caused shift process to wait too long
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3627 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
e48189c710
enhanced cluster routing
...
- cluster definitions can now contain an addition for local ip addresses
- cluster-cluster communication uses the local ip address instead the global address, if one is given
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3624 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
karlchenofhell
97d4ab2053
- handle null from iterator in IndexCreateWWWLocalQueue_p.java
...
- fixed ETA to reach next peer in Network.java
- added some <label>s and fxied minor XHTML errors in ConfigNetwork.html
- try to avoid returning null in servlets as it is unexpected and causes a NPE in the file handler
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3623 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
b33cef421e
better routing for public clusters
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3620 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
michitux
f5e6a5d8b2
Fixed media search: parameters were in the wrong order.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3619 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
(no author)
44fe8361ae
*) re-enable popup configuration on status-page
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3617 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
(no author)
d5b7eac6d7
*) aquirerelease should now work again
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@3616 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago