You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
129 lines
6.8 KiB
129 lines
6.8 KiB
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" "http://www.w3.org/TR/REC-html40/loose.dtd">
|
|
<html>
|
|
<head>
|
|
<title>YaCy '#[clientname]#': Index Monitor</title>
|
|
#%env/templates/metas.template%#
|
|
</head>
|
|
<body marginheight="0" marginwidth="0" leftmargin="0" topmargin="0">
|
|
#%env/templates/header.template%#
|
|
<table width="100%" border="0" cellpadding="0" cellspacing="0" class="SubMenu">
|
|
<tr height="10"><td colspan="13" class="MenuHeader"> Index Monitor Menu</td></tr>
|
|
<tr height="2"><td colspan="13"></td></tr>
|
|
<tr class="TableHeader">
|
|
<td width="16%" class="MenuSubItem"> <a href="/IndexMonitor.html" class="MenuItemLink">Index Monitor Overview</a> </td>
|
|
<td class="MenuSubSpacer"></td>
|
|
<td width="14%" class="MenuSubItem"> <a href="/IndexMonitor.html?process=1" class="MenuItemLink">(1) <img border="0" src="/env/grafics/lock.gif" align="top" alt="password-protected"> Receipts</a> </td>
|
|
<td class="MenuSubSpacer"></td>
|
|
<td width="14%" class="MenuSubItem"> <a href="/IndexMonitor.html?process=2" class="MenuItemLink">(2) <img border="0" src="/env/grafics/lock.gif" align="top" alt="password-protected"> Queries</a> </td>
|
|
<td class="MenuSubSpacer"></td>
|
|
<td width="14%" class="MenuSubItem"> <a href="/IndexMonitor.html?process=3" class="MenuItemLink">(3) <img border="0" src="/env/grafics/lock.gif" align="top" alt="password-protected"> DHT Transfer</a> </td>
|
|
<td class="MenuSubSpacer"></td>
|
|
<td width="14%" class="MenuSubItem"> <a href="/IndexMonitor.html?process=4" class="MenuItemLink">(4) <img border="0" src="/env/grafics/lock.gif" align="top" alt="password-protected"> Proxy Use</a> </td>
|
|
<td class="MenuSubSpacer"></td>
|
|
<td width="14%" class="MenuSubItem"> <a href="/IndexMonitor.html?process=5" class="MenuItemLink">(5) <img border="0" src="/env/grafics/lock.gif" align="top" alt="password-protected"> Local Crawling</a> </td>
|
|
<td class="MenuSubSpacer"></td>
|
|
<td width="14%" class="MenuSubItem"> <a href="/IndexMonitor.html?process=6" class="MenuItemLink">(6) Global Crawling</a> </td>
|
|
</tr>
|
|
</table>
|
|
<br>
|
|
|
|
#(process)#
|
|
<h2>Indexing Queues Monitor Overview</h2>
|
|
<p>These are monitoring pages for the different indexing queues.<p>
|
|
<p>YaCy knows 5 different ways to acquire web indexes. The details of these processes (1-5) are described within the submenu's listed
|
|
above which also will show you a table with indexing results so far. The information in these tables is considered as private,
|
|
so you need to log-in with your administration password.</p>
|
|
<p>Case (6) is a monitor of the local receipt-generator, the opposed case of (1). It contains also an indexing result monitor but is not considered private
|
|
since it shows crawl requests from other peers.
|
|
</p>
|
|
<p><img src="/env/grafics/indexmonitor.png"></p>
|
|
<p>The image above illustrates the data flow initiated by web index acquisition.
|
|
Some processes occur double to document the complex index migration structure.
|
|
</p>
|
|
::
|
|
<h2>(1) Index Monitor of Remote Crawl Receipts</h2>
|
|
<p>This is the list of web pages that this peer initiated to crawl,
|
|
but had been crawled by <i>other</i> peers.
|
|
This is the 'mirror'-case of process (6).
|
|
</p>
|
|
<p><i>Use Case:</i> You get entries here, if you start a local crawl on the 'Index Creation'-Page and check the
|
|
'Do Remote Indexing'-flag. Every page that a remote peer indexes upon this peer's request
|
|
is reported back and can be monitored here.<p>
|
|
::
|
|
<h2>(2) Index Monitor for Result of Search Queries</h2>
|
|
<p>This index transfer was initiated by your peer by doing a search query.
|
|
The index was crawled and contributed by other peers.</p>
|
|
<p><i>Use Case:</i> This list fills up if you do a search query on the 'Search Page'</p>
|
|
::
|
|
<h2>(3) Index Monitor for Index Transfer.</h2>
|
|
<p>The url fetch was initiated and executed by other peers.
|
|
These links here have been transmitted to you because your peer is the most appropriate for storage according to
|
|
the logic of the Global Distributed Hash Table.</p>
|
|
<p><i>Use Case:</i> This list may fill if you check the 'Index Receive'-flag on the 'Index Control' page</p>
|
|
::
|
|
<h2>(4) Index Monitor for Proxy Indexing</h2>
|
|
<p>These web pages had been indexed as result of your proxy usage.
|
|
<b>No personal or protected page is indexed</b>;
|
|
such pages are detected by Cookie-Use or POST-Parameters (either in URL or as HTTP protocol)
|
|
and automatically excluded from indexing.</p>
|
|
<p><i>Use Case:</i> You must use YaCy as proxy to fill up this table.
|
|
Set the proxy settings of your browser to the same port as given
|
|
on the 'Settings'-page in the 'Proxy and Administration Port' field.</p>
|
|
::
|
|
<h2>(5) Index Monitor for Local Crawling.</h2>
|
|
<p>These web pages had been crawled by your own crawl task.</p>
|
|
<p><i>Use Case:</i> start a crawl by setting a crawl start point on the 'Index Create' page.</p>
|
|
::
|
|
<h2>(6) Index Monitor for Global Crawling</h2>
|
|
<p>These pages had been indexed by your peer, but the crawl was initiated by a remote peer.
|
|
This is the 'mirror'-case of process (1).</p>
|
|
<p><i>Use Case:</i> This list may fill if you check the 'Accept remote crawling requests'-flag on the 'Index Crate' page</p>
|
|
#(/process)#
|
|
|
|
|
|
#(table)#
|
|
<p><i>The stack is empty.</i></p>
|
|
::
|
|
<p><i>
|
|
#(size)#
|
|
Showing all #[all]# entries in this stack.
|
|
::
|
|
Showing latest #[count]# lines from a stack of #[all]# entries.
|
|
#(/size)#
|
|
</i>
|
|
<table border="0" cellpadding="2" cellspacing="1" width="100%">
|
|
<tr class="TableHeader">
|
|
<td class="small"><form action="#[feedbackpage]#" method="post" enctype="multipart/form-data">
|
|
<input type="hidden" name="process" value="#[tabletype]#">
|
|
<input type="submit" name="clearlist" value="clear list"></form></td>
|
|
#(showInit)#::<td class="small"><b>Initiator</b></td>#(/showInit)#
|
|
#(showExec)#::<td class="small"><b>Executor</b></td>#(/showExec)#
|
|
<td class="small"><b>Modified Date</b></td>
|
|
<td class="small"><b>#Words</b></td>
|
|
<td class="small"><b>Title</b></td>
|
|
<td class="small"><b>URL</b></td>
|
|
</tr>
|
|
#{indexed}#
|
|
<tr class="TableCell#(dark)#Light::Dark#(/dark)#" class="small">
|
|
<td width="30" class="small">
|
|
<form action="#[feedbackpage]#" method="post" enctype="multipart/form-data">
|
|
<input type="hidden" name="process" value="#[tabletype]#">
|
|
<input type="hidden" name="hash" value="#[urlhash]#">
|
|
<input type="submit" name="deleteentry" value="delete" class="small">
|
|
</form></td>
|
|
#(showInit)#::<td width="60" class="small">#[initiatorSeed]#</td>#(/showInit)#
|
|
#(showExec)#::<td width="60" class="small">#[executorSeed]#</td>#(/showExec)#
|
|
<td width="80" class="small">#[moddate]#</td>
|
|
<td width="40" class="small">#[wordcount]#</td>
|
|
<td width="180" class="small">#[urldescr]#</td>
|
|
<td class="small">#[url]#</td>
|
|
</tr>
|
|
#{/indexed}#
|
|
</table><br>
|
|
</p>
|
|
::
|
|
#(/table)#
|
|
#%env/templates/footer.template%#
|
|
</body>
|
|
</html>
|