a67ff1c8ac
SMW Import: replaced JSON import routines with stable ones
13 years ago
328ce0b297
fix: remove fixed individual testing IP (85.25.151.30 = server4you.de) from default/yacy.network.freeworld.unit
13 years ago
2e7219f9fd
removed hightlighting of search results within collections in GSA
...
interface
13 years ago
074dfd297b
added icons and a selection for hosts with urls pending for crawler or
...
with errors
13 years ago
d2a94cc55e
refactor package
13 years ago
05742b4562
remove old SMW importer which was part of the ymarks package
13 years ago
21df1ad9e0
update and generalization of the SMW import and content control routines
13 years ago
f07e5fb553
release 1.2
13 years ago
4c4e0eece2
added new submenu 'Target Analysis' with three servlets which are useful
...
to analyse the target servers: robots.txt table, mass target analysis
and a regex tester
13 years ago
61995d508e
do the commit anyway before calling a search interface
13 years ago
842faf96a2
fixed media search
13 years ago
86ec199126
using a better file name
13 years ago
93001586a0
removed warnings, removed too-fast pausing of crawls
13 years ago
8041742e48
added matching of path to query pattern
13 years ago
8b1c9cba3d
fixed a problem with non-terminating crawls
13 years ago
61a1d32356
fix to ftp client
13 years ago
5105256927
update to search result logging (this was a remaining issue from the
...
solr 4.0.0 migration)
13 years ago
570e42c4e3
fix for filetype naviagtor
13 years ago
71ed8e5e07
bugfixes for crawler
13 years ago
29fbbb49dc
better colors for host browser and corrected document count
13 years ago
12c0db20e5
fixed npe for surrogate import
13 years ago
6244b084cd
fixed wrong order of result count values
13 years ago
631b08e7e2
update to HostBrowser
13 years ago
51f420e4f5
removed location search because it is only working in special cases
13 years ago
52df6ee369
more logging
13 years ago
158732af37
automatically delete entries from the crawl profile list if crawl is
...
terminated.
13 years ago
15d1460b40
added information about the reason of pausing of crawls
13 years ago
2371ef031c
added solr faceted search support to YaCy search results
...
added solr highlighting / YaCy snippets to YaCy search results
- facets are now much more complete
- facets are computed and searched much faster
- snippet computation is done by solr if solr knows the snippet
13 years ago
b30a7162fa
added more thread-renaiming for search processes
13 years ago
900445d8e9
set the thread name during solr queries to the solr query to get better
...
debugging options
13 years ago
d481abd087
added the visualization of error-urls to host browser
...
- only visible for admins
- a faceted search generates a huge list for all hosts in the host list
- the faceted search algorithms had to be modified for that
- within the browsing of the directory path, the error cause is written
to the url which is presented as error-url
- the errors are also accumulated for directory sums
13 years ago
a15819fbec
fix for some interface problems
13 years ago
791e1dcfdf
when a new crawl is started, delete all entries about error-urls for
...
crawl-start domains
13 years ago
c6a6f4c4e6
added a hack which makes the HostBrowser more performant when the given
...
host has a lot of urls. If the number of urls is > 1000, then the list
of documents is restricted to such which have no subpath, if the root
path is selected. However, this can cause a problem if no documents on
the root path exist but only on paths below that root path.
13 years ago
619bf7e875
fixed filetype modified for media types in text search
13 years ago
97f82994a6
automatically pause the crawler if there is a problem with solr
13 years ago
64ac2b7b7d
new submenu template
13 years ago
5e77801aac
update to web interface structure
13 years ago
8fb370d9f8
renovated the way how search results are count. should be correct now...
13 years ago
7bec253bb0
Merge branch 'master' of ssh://git@gitorious.org/yacy/rc1.git
13 years ago
d88eb657fd
Merge branch 'master' of git://gitorious.org/~reger/yacy/bbyacy-rc1
13 years ago
354ef8000d
- added 'deleteold' option to crawler which causes that documents are
...
deleted which are selected by a crawl filter (host or subpath)
- site crawl used this option be default now
- made option to deleteDomain() concurrency
13 years ago
633fbe9188
Fix Metadata handling
...
- language default on missing lang property to "uk" (fix set to nothing)
- language set to TLD (added call to existing language calculation from TLD)
- coordinate number exception on possible lat/lon content of "NaN,NaN"
adjust Netbeans IDE classpath (for Solr/Lucene 4.0.0 jars)
13 years ago
19d1f474ce
host browser now shows also number of pending files per subdirectory +
...
bugfixes
13 years ago
75dd706e1b
update to HostBrowser:
...
- time-out after 3 seconds to speed up display (may be incomplete)
- showing also all links from the balancer queue in the host list (after
the '/') and in the result browser view with tag 'loading'
13 years ago
e2c4c3c7d3
migration to solr 4.0.0
13 years ago
b764de424a
code cleanup
13 years ago
69aa39d664
update to libraries required by solr 4.0.0
13 years ago
9330ad4838
- fixed the delete option in host browser
...
- added a delete method which can be used to delete a full subpath in
solr.
13 years ago
a63179f3f9
added the MIME attribute for the R tag in GSA search result writer
13 years ago
cominch