19e35a9126
add type attribute to atom feed <link> tag
...
(for /yacysearch.atom)
10 years ago
51bb21c6b4
reverted .classpath from cherry-picked
...
ce1fd1e901
10 years ago
2dd8be3c66
updated the traduction of Status_p.inc in the french locale
10 years ago
e50b2b4d04
fix test case MultiProtocolURL.toString()
...
(only allowed on AnchorURL)
10 years ago
0a2f4a0e2f
eliminate lat/lon type conversion in osm
...
(define as double)
10 years ago
7584352e7b
use more predefined Solr query parameter constants
...
- use CommonParams and DisMaxParams constants
- fix typo in get sort parameter
- getDocumentCountByParams redundant implementation and risk of not optimized call (row parameter unspecified) -> as only used from getCountByQuery removed from interface
10 years ago
f9db5dd6c5
reduce doublecontent check document (prevent out of memory)
...
see http://mantis.tokeek.de/view.php?id=437
test result (concurrency=7)
2000 docs = eom always
1000 docs = eom always
100 docs = eom never
chosen -> 200 docs (eom not encountered during test with 1GB mem setting)
10 years ago
e9eae45b55
simplify rssreader and improve atom feed link extraction
...
- type detection (rss/atom)
- init type parameter overwritten during parse, parameter obsolete
- detection by endtag changed to simpler first-tag evaluation
- channel image not used, removed related extra parser handling
- remove unused code (set/getImage) in rssfeed
- atom link extraction to account for possible multipe link tags
- spec limits link to one with rel="alternate" or one without rel attribute
not accounting for the follwing type & hreflang exception yet:
o atom:entry elements MUST NOT contain more than one atom:link
element with a rel attribute value of "alternate" that has the
same combination of type and hreflang attribute values.
10 years ago
a8508417d1
catch NPE during crawl (OAI import)
...
- condenseDocument mime=null (allowed)
- collectionconfiguration responseheader = null (allowed)
10 years ago
3dde94422f
center searchevent lines on network graph
...
(PerformanceSearch_p.html)
10 years ago
3860711aef
fix for possible interruption of concurrent queries
10 years ago
01bbb20666
increased default logging line count to max
10 years ago
6344718f8b
reducing the concurrent query stack size and reduced concurrency of
...
postprocessing to avoid OOM situations
10 years ago
eca9380e3d
bugfix for crawler double-check: if an url is redirected, the
...
redirect-target was not double-checked. This is now done by replacing
the redirect-URL on the crawl queue again (where it is double-checked)
10 years ago
9ac0c93f17
fix for subpath crawl filter
10 years ago
9bc3e457dd
fix for termination of all crawls
10 years ago
66106bdaf0
fix for crawler attribute maxdompages
10 years ago
49d91b94c3
npe fix in crawler
10 years ago
8d650ca225
added hint to port forwarding videos
10 years ago
b7183a7321
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
10 years ago
ea2e627662
fix ConfigAccounts del user with uppercase letter in name
...
(usernames are case sensitive, userdb.delete used toLower)
10 years ago
c465b791af
typo
10 years ago
191ec8c82a
added concurrency to postprocess rewrite process
10 years ago
a1e8bdd5e9
log ppm instead of docs/second
10 years ago
cc0ded7abd
set process type of web graph according to fields as defined in the
...
schema
10 years ago
12fb9d7cd1
log postprocessing constraints in case that postprocessing is not
...
performed
10 years ago
3c23b89823
less logging
10 years ago
a0c53174c5
better solr query logging to detect unnecessary sort requests for more
...
performance profiling
10 years ago
338f574bdc
no sorting if http/www unique fields are not demanded (makes query
...
faster) and some code restrucuring
10 years ago
1609763be5
toString fix
10 years ago
b983e68254
more retries, less sleep
10 years ago
1503ba7794
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
10 years ago
8f77719091
fix "Ljava.lang.String" in crawl queue anchor name
...
(e.g. IndexCreateQueues_p.html?stack=LOCAL with images in queue)
10 years ago
0ceeceb35e
more logic on Solr queries; usage of the query terms in posprocessing,
...
saving one query for double document detection now per document
10 years ago
3963bca3b6
catch IndexControlRWIs_p error if RWI not connected
10 years ago
38864ae004
Merge branch 'master' of git@gitorious.org:yacy/rc1.git
10 years ago
4099296b45
added new classes which shall reduce call overhead to Solr (stub)
10 years ago
d0c02e1de7
adjust rss lat/lon to double
...
(common format across other classes)
10 years ago
3491ab4c38
removed unused images from webgraph edge computation
10 years ago
2371d6b8db
target linktexts must be string to enable search facets on these fields
10 years ago
001e05bb80
do not store failure of loading of robots.txt into the index as a fail
...
document
10 years ago
05d58e4df0
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
10 years ago
98f45c9032
fix for image alt attachment to AnchorURLs in html parser.
10 years ago
22ce4fb4dd
better error handling for remote solr queries and exists-checks
10 years ago
b510b182d8
- update Maven pom
...
- add ppt parser test case
10 years ago
3dcfc717eb
This hopefully fixes http://mantis.tokeek.de/view.php?id=424
10 years ago
9df14fc126
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
10 years ago
477be17c51
Replaced old UPNP library with Weupnp. UPNP should
...
work now, at least it does on my network. UPNP code in YaCy can still
be improved though (see TODO comment: make port on gateway configurable
or find free one).
*) removed old code
*) added new lib
*) changed code to work with new lib
10 years ago
738989aab7
reverted commit f94c91315b because the
...
webgraph has not enough performance for that
10 years ago
e9163e7e10
fix for malformed hostpath names in crawl balancer
10 years ago
reger