80fb1026d0
Create recrawl requests with the relevant crawl profile.
...
Recrawl default profile was previously effectively used for crawl
stacker acceptance check, but request entries were indeed still created
with the "snippetGlobalText" profile.
7 years ago
539925a275
Added an utility to generate/update XLIFF master file from lng files.
7 years ago
41a6b052d9
Updated master and French translation for the IndexReIndexMonitor_p page
7 years ago
fa6d030b0b
Moved dbtest to the test source folder.
7 years ago
6cd3847d0a
Fixed NullPointerException case on Table init with relative file path.
...
Can occur for example when running dbtest with relative test table file
name (wihout explicit parent folder).
7 years ago
28883d8a71
Shutdown daemon threads at the end of dbtest
7 years ago
929e0d6eae
Replaced improper ByteBuffer.equals() implementation by Arrays.equals()
...
Renamed also ByteBuffer.equals() to startsWith() as this is the
appropriate function implementation semantics.
7 years ago
098ee63911
Added a manual performance test for the HostBalancer.
...
Consequently to the report in mantis 776
(http://mantis.tokeek.de/view.php?id=776 ).
Running the perfs test with different control parameters seems to reveal
that the YaCy's RowHandleMap used in the balancer depthCache is finally
more efficient than for example the ConcurrentHashMap from JDK 8.
7 years ago
fefe2d1b6e
Merge branch 'master' of https://github.com/yacy/yacy_search_server.git
7 years ago
5aa4fb1144
upd to metadata-extractor-2.11.0.jar
7 years ago
46b5249c20
Removed time condition on HostBalancer initialization in JUnit test.
...
Its initialization in main application usage remains asynchronous.
7 years ago
8b572b7337
Commit Solr index before simulating or starting recrawl job.
...
This ensures up-to-date simulation query results, and recrawl
processing.
7 years ago
5b943c07ab
Merge pull request #155 from JeremyRand/readme-typo-fixes
...
Fix some typos in the README.
7 years ago
dea856c854
Fix some typos in the README.
7 years ago
733cacdbb8
Revised the RDFaParser main launcher for minimal proper operation.
...
This parser is still not enabled in the main text parsers list. More
would have to be done to make it functional.
7 years ago
7baa99f26f
Fixed stored URL in web cache when redirection(s) occurs.
...
Associate cached content to the last redirection location, instead of
the first URL of a redirection(s) chain :
- for proper base URL processing in parsers (fixes mantis 636 -
http://mantis.tokeek.de/view.php?id=636 )
- to prevent duplicated content in Solr index when recrawling a
redirected URL
7 years ago
5e2812c060
Automatically refresh running recrawl report when JavaScript is enabled.
...
For users who would prefer to keep JavaScript disabled, a manual Refresh
button is still available.
7 years ago
19903a984f
Merge pull request #154 from tangdou1/master
...
update chinese translation
7 years ago
49d103ad16
Merge pull request #1 from tangdou1/tangdou1-patch-1
...
Update zh.lng
7 years ago
dd4f93f049
Update zh.lng
...
translate some untranslated words to chinese.
7 years ago
e585b4f597
Update zh.lng
7 years ago
0fce264ba4
Set reindex page to html5 and removed presentational only html tables.
7 years ago
83df922afc
Removed unused duplicated HTML id on header hidden field
7 years ago
9ddf92d143
Removed unncessary reflection usage for workflow tasks.
...
This improves code readability and maintainability (calls hierarchy are
easier to read) and eventually performance.
7 years ago
897d3d30cc
Added new recrawl job profile to the list of default crawl profiles
7 years ago
9624516bf8
Refresh recrawl job profile threshold date like other default profiles
7 years ago
b712a0671e
Added a specific default crawl profile for the recrawl job.
...
- with only light constraint on known indexed documents load date, as it
can already been controlled by the selection query, and the goal of the
job is indeed to recrawl selected documents now
- using the iffresh cache strategy
7 years ago
adf3fa493d
Added comments about crawl profiles recrawl cycles
7 years ago
3638e16c2e
More comprehensive log on rejected recrawls caused by date constraint
7 years ago
d47afe6fab
Use a constant for crawler reject reason prefix with specific processing
7 years ago
4e03335625
Added more details to the recrawl job report
7 years ago
d95d393a0d
Add a query link to local Solr to browse selected recrawl candidates
7 years ago
59f7763af6
Display recrawl job report also when job is actively running
7 years ago
6425963cee
Fixed internal tables exact value match iterator
7 years ago
0c9e0b3566
Record recrawl calls to make them schedulable
7 years ago
433e241e4f
Added a report info box about eventual last terminated recrawl job
...
For easier monitoring of recrawls.
7 years ago
b2af25b14f
Added a stop condition to the Recrawl busy thread
7 years ago
421728d25a
Made possible to customize selection query before launching a recrawl
7 years ago
fab6e54fec
Enforced controls (HTTP method, token) on ReIndex and ReCrawl operations
7 years ago
36e9b1c5b3
Fixed SegmentTest test case time dependant occasional failures
...
As highlighted by latest automated Travis builds.
7 years ago
8a4ea1c11e
Added UI switch to control content domain constraint per search request
7 years ago
36a45b3905
Added UI setting for strictness of content-type checking on media search
7 years ago
cedb53be4e
upd to commons-io-2.6
7 years ago
f8071ac8ae
Make TokenizedStringNavigator (used for keyword search facet) active
...
check case insensitive.
As keywords are compared lower case, make sure user input keyword:Key
or keyword:key will be shown as active in facet entry key.
7 years ago
270b77074e
upd to httpclient-4.5.4 and httpmime-4.5.4
7 years ago
6db7f5525b
upd to icu4j-60.2
7 years ago
e6907fdab3
Added optional search parameter/setting to control content domain filter
...
Thus allowing to choose at configuration or per search request, whether
extending or not results beyond strict content domain filter (image,
video, audio or application).
Related graphical controls to be added to user interface.
7 years ago
f52217c939
Enable full size images preview for users with extended search rights
7 years ago
d42c1773c8
Added UI setting for optional encryption with https on p2p searches
7 years ago
09c4ee56a7
Added optional https support for remote crawl and profile operations
7 years ago
luccioman