fuchsi
1cb6e431a6
Replace the ISO8601 aka W3C datetime parser by one that supports every representation allowed by this standard, see http://www.w3.org/TR/NOTE-datetime
...
- useful expecially for sitemaps parsing, where this date format is used
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4286 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
fuchsi
33ee6745f6
more cleanup in serverDate
...
- remove direct accesses to SimpleDateFormat fields in serverDate and use the static parse... methods instead
- remove nowDate() as a Date doesn't store timezone information and a new Date() is always faster
- default formatter methods use a GMT timezone by default now, this is important for interchangability as some date formats we use don't include a timezone offset.
- continued renaming and rearanging (formatter) methods. all should follow the general naming scheme formatWHAT(...)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4285 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
fuchsi
3c30c2da75
more cleanup and API consistency changes, more to come...
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4284 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
low012
5aa8d72502
*) cleaned up code for better readability in Netbeans (tabs -> spaces)\n*) no functional changes
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4282 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
fuchsi
21b8d1b918
small cosmetic change for static fields in serverCore (special protocol ASCII entities) to improve readability
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4275 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
270d016d89
fix for missing anonymization in search profiling
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4274 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
b1e08d354c
repaired indexing after search snippet loading
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4268 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
5a80359b0e
new default remote favicon for search results
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4266 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
9e23acf2d6
introduced new 'authority' ranking property
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4265 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
6a3a292015
- smoothed ymage font
...
- changed position of status banner
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4261 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
4331e52d1c
fixed too small peer number in banner
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4259 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
515e1bde6d
- fixed bug with constraint default
...
- 0.556
- default RAM for pro releases now 120MB (because pro will become default)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4258 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
2954f96fae
- removed public peer info box on status page, this info can now be seen in the status banner
...
- added peer count to banner
- added some values to protected status box
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4257 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
aeb1cf83a6
- corrected banner link (relative now)
...
- changed color mode (replace) for banner
- changed default color (fits to default skin) of banner in status
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4255 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
5185acaf41
- reduced default search time
...
- this can be configured using the network definition file
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4254 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
e22014dc83
some memory enhancements when generating and displaying ymage objects
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4253 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
f243e338cf
implemented online caution also for local and remote search
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4252 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
6680634703
removed unnecessary functions
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4251 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
c57eb76b13
removed CMY color model from ymage classes and re-introduced RGB color model
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4249 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
b46bcaa5d8
changed method of profiling
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4248 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
low012
76cd6ed6f6
*) New methods to insert bitmaps that feature transparencies.
...
*) Logo background is transparent now. (Using pixel at (0,0) to determine which color is transparent. Too dirty?)
*) Logo is loaded through filesystem instead of HTTP now.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4247 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
be214e594f
- generalized ymage initialization options
...
- auto-adoption of performance memory graph to needed dimension
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4246 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
low012
72698fcd36
*) Banner features a logo now. It does not look nice, but at least it works. Banner is not finished yet.
...
Which path do I have to set for IMAGE (htroot/env/grafics/yacy.gi) if I want to load it through the file system and not via HTTP?
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4244 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
3f848e282b
PerformanceMemory_p now does a automatic update of memory graph every second
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4242 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
aefb3f7765
added memory graph picture to PerformanceMemory_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4241 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
ea81d97cfc
fix for bad full domain crawl depth adoption
...
(maximum depth is 8, because higher depth will cause that remote crawls do not work)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4240 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
f645408ae9
added url retrieve option to uls.xml interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4239 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
cc20870267
fix for constraint handover problem:
...
old yacy versions set a catchall-constraint if no constraint is given, but the
new versions expect a null-constraint.
see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=565&hilit=
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4238 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
9b0ae4b989
added referrer to remote crawl url list
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4236 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
d59c1a7936
removed test data
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4233 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
89b9b2b02a
redesigned remote crawl process:
...
- instead of pushing urls to other peers, the urls are actively pulled
by the peer that wants to do a remote crawl
- the remote crawl push process had been removed
- a process that adds urls from remote peers had been added
- the server-side interface for providing 'limit'-urls exists since 0.55 and works with this version
- the list-interface had been removed
- servlets using the list-interface had been removed (this implementation did not properly manage double-check)
- changes in configuration file to support new pull-process
- fixed a bug in crawl balancer (status was not saved/closed properly)
- the yacy/urls-protocol was extended to support different networks/clusters
- many interface-adoptions to new stack counters
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4232 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
2fcd18a972
- fixed bad behaviour of search event worker processes
...
- fixed export of url lists in xml
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4229 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
445c0b5333
added domain list extraction and html export format
...
to URL administration menu http://localhost:8080/IndexControlURLs_p.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4228 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
bf6952abe7
- added url export to http://localhost:8080/IndexControlURLs_p.html
...
- removed command-line option to export urls
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4226 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
edba2b7bcc
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=543
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4224 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
c48b73cda2
redesign of ranking data structure
...
- the index administration now uses the same code base for url selection and collection
as the search interface. The index administration is therefore a good test environment for
ranking order control
- removed old postsorting-algorithms, will be replaced with new one
- fixed many bugs occurred before during ranking; especially the contraint filtering method
removed too many links
- fixed media search flags; had been attached to too many urls. The effect should be a better
pre-sorting before media load within snippet fetch
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4223 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
6f1308da2f
- some enhancements to IndexControlURLs (shows more links, connects referrer to another query)
...
- some refactoring to search process
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4222 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
bf9a9e4e5e
fix for NPE in IndexControlRWIs_p.java
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4221 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
c527969185
- enhanced monitoring of ranking parameters
...
for details, please try http://localhost:8080/IndexControlRWIs_p.html
- fixed computation of ranking ordering in some cases
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4220 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
bd5673efbe
added cleaning of search event before opening the index administration
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4219 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
55da871211
preparations for better ranking: better debugging of index properties
...
to do this, the index administration interface was extended.
It is now possible to select parts of a index.
See properties shown in interface after a word search for details.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4218 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
low012
383dc815d2
*) fix for commit 4212
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4217 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
3491531cea
- fixed 'appears in url' flag in index generation
...
- extended index administration page, shows some properties to the web links now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4216 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
daburna
19176e12e2
-corrected typo made in 4213
...
-updated translation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4215 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
ca4ca79eba
removed wrong hints to installation page.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4213 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
low012
a01c42575d
*) 404 error pages will be displayed with correct CSS and favicon now ( http://forum.yacy-websuche.de/viewtopic.php?t=482 )
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4212 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
bc2368e907
fix for problem with remote crawl referrers
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4210 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
2e91b724ad
fix for yacysearch/rss-feed bug
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4203 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
0eb60cfe6f
better handling of seed properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4199 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago
orbiter
6eaa5a0e64
enhanced local search speed. The ranking process is now 6 times faster that before.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4197 6c8d7289-2bf4-0310-a012-ef5d649a1542
18 years ago