orbiter
b46bcaa5d8
changed method of profiling
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4248 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
76cd6ed6f6
*) New methods to insert bitmaps that feature transparencies.
...
*) Logo background is transparent now. (Using pixel at (0,0) to determine which color is transparent. Too dirty?)
*) Logo is loaded through filesystem instead of HTTP now.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4247 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
be214e594f
- generalized ymage initialization options
...
- auto-adoption of performance memory graph to needed dimension
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4246 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
ee8a177c26
*) Logo is in the middle of free space now.
...
*) Fixed bugs in insertBitmap()
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4245 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
72698fcd36
*) Banner features a logo now. It does not look nice, but at least it works. Banner is not finished yet.
...
Which path do I have to set for IMAGE (htroot/env/grafics/yacy.gi) if I want to load it through the file system and not via HTTP?
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4244 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
39d0f10ca1
Fix parsing oof dates in HTTP headers.
...
RFC 2616 requires a client to support RFC 1123 (default), RFC 1036 and ANSI C formatted date strings (we only supported 1123 before).
Closes: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=525 (and probably others). There are servers which break the standards, please report those "DATE ERROR" messages if they contain a "sane" date string.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4243 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3f848e282b
PerformanceMemory_p now does a automatic update of memory graph every second
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4242 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
aefb3f7765
added memory graph picture to PerformanceMemory_p.html
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4241 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ea81d97cfc
fix for bad full domain crawl depth adoption
...
(maximum depth is 8, because higher depth will cause that remote crawls do not work)
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4240 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
f645408ae9
added url retrieve option to uls.xml interface
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4239 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
cc20870267
fix for constraint handover problem:
...
old yacy versions set a catchall-constraint if no constraint is given, but the
new versions expect a null-constraint.
see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=565&hilit=
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4238 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
5ba415570e
#updated German language file
...
now the new IndexControlsites are complete translated
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4237 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
9b0ae4b989
added referrer to remote crawl url list
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4236 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
18e516317d
Fix problem with buggy HTTP-Servers which send illegal control characters in HTTP-Headers, they are ignored now.
...
Thx to celle for the patch and see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=560 for more information.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4235 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
7d5544e9b1
added some security checks to new remote crawl pull method to prevent that indexer is overloaded
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4234 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d59c1a7936
removed test data
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4233 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
89b9b2b02a
redesigned remote crawl process:
...
- instead of pushing urls to other peers, the urls are actively pulled
by the peer that wants to do a remote crawl
- the remote crawl push process had been removed
- a process that adds urls from remote peers had been added
- the server-side interface for providing 'limit'-urls exists since 0.55 and works with this version
- the list-interface had been removed
- servlets using the list-interface had been removed (this implementation did not properly manage double-check)
- changes in configuration file to support new pull-process
- fixed a bug in crawl balancer (status was not saved/closed properly)
- the yacy/urls-protocol was extended to support different networks/clusters
- many interface-adoptions to new stack counters
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4232 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
fuchsi
69521d92e5
Add another external dependency from PDFBox package ("Bouncy Castle"). This is necessary for parsing of some encrypted PDF files.
...
bcprov-jdk14-132.jar is the binary jar as it is provided in the PDFBox-0.7.3 package (same as our FontBox, PDFBox packages).
Closes: http://forum.yacy-websuche.de/viewtopic.php?f=6&t=453
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4231 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
90a02990d2
NPE fix, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=549&hilit=&p=3383#p3383
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4230 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2fcd18a972
- fixed bad behaviour of search event worker processes
...
- fixed export of url lists in xml
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4229 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
445c0b5333
added domain list extraction and html export format
...
to URL administration menu http://localhost:8080/IndexControlURLs_p.html
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4228 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d8d77fc4b2
fix for NPE, see http://forum.yacy-websuche.de/viewtopic.php?f=6&t=549&hilit=&p=3368#p3368
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4227 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bf6952abe7
- added url export to http://localhost:8080/IndexControlURLs_p.html
...
- removed command-line option to export urls
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4226 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
af10f729df
fixed image search and favicon loading
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4225 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
edba2b7bcc
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=543
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4224 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
c48b73cda2
redesign of ranking data structure
...
- the index administration now uses the same code base for url selection and collection
as the search interface. The index administration is therefore a good test environment for
ranking order control
- removed old postsorting-algorithms, will be replaced with new one
- fixed many bugs occurred before during ranking; especially the contraint filtering method
removed too many links
- fixed media search flags; had been attached to too many urls. The effect should be a better
pre-sorting before media load within snippet fetch
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4223 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
6f1308da2f
- some enhancements to IndexControlURLs (shows more links, connects referrer to another query)
...
- some refactoring to search process
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4222 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bf9a9e4e5e
fix for NPE in IndexControlRWIs_p.java
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4221 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
c527969185
- enhanced monitoring of ranking parameters
...
for details, please try http://localhost:8080/IndexControlRWIs_p.html
- fixed computation of ranking ordering in some cases
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4220 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bd5673efbe
added cleaning of search event before opening the index administration
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4219 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
55da871211
preparations for better ranking: better debugging of index properties
...
to do this, the index administration interface was extended.
It is now possible to select parts of a index.
See properties shown in interface after a word search for details.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4218 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
383dc815d2
*) fix for commit 4212
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4217 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
3491531cea
- fixed 'appears in url' flag in index generation
...
- extended index administration page, shows some properties to the web links now
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4216 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
19176e12e2
-corrected typo made in 4213
...
-updated translation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4215 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ec7ba0d3d0
- fixed problem with too small sort fields (sortbound was not set)
...
- slightly changed handling of date in indexURLEntry
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4214 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
ca4ca79eba
removed wrong hints to installation page.
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4213 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
a01c42575d
*) 404 error pages will be displayed with correct CSS and favicon now ( http://forum.yacy-websuche.de/viewtopic.php?t=482 )
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4212 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
2b57d64de3
*) typo ( http://forum.yacy-websuche.de/viewtopic.php?t=428 )
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4211 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
bc2368e907
fix for problem with remote crawl referrers
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4210 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
875096552f
fix for NPE in case that remote search results are empty
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4209 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
64b3b79e44
- fix for termination problem with uniq()
...
- addition to seed dna interpretation
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4208 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
0abf33ed03
- tried to remove deadlock
...
- enhanced searchtime in kelondroRowSets
- enhanced uniq() - reverse enumeration causes less time in case of mass removal of doubles
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4207 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
low012
a4010f7dc8
*) fixed bug where dots were added after numbers < 1000: "123" was transformed to "123." which is undesirable
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4206 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
daburna
da73cde86e
#German language file
...
- some cosmetics
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4205 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2421127612
fix for http://forum.yacy-websuche.de/viewtopic.php?f=6&t=513&hilit=
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4204 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
2e91b724ad
fix for yacysearch/rss-feed bug
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4203 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
d0d2771883
disabled multiprocessoring of rowCollection.sort for testing purpose
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4202 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
edc4da5317
fix for division by zero in test reoutine
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4201 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
df38aaf7bd
update to RowCollection sort speed-enhancements:
...
- better handling of small collections (less overhead)
- usage of pre-sorted limits
- different re-sort limit
- more testing procedures
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4200 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago
orbiter
0eb60cfe6f
better handling of seed properties
...
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@4199 6c8d7289-2bf4-0310-a012-ef5d649a1542
17 years ago