Commit Graph

392 Commits (9a66a8b9a867f2c151ab2e041f50b2b90cd78851)

Author SHA1 Message Date
orbiter 0e8647d62f refactoring of search classes
16 years ago
orbiter dafffd0153 refactoring of parsers and document processing
16 years ago
orbiter 154bbc3364 code cleanup: call of static methods directly to the class
16 years ago
orbiter 222850414e simplification of the code: removed unused classes, methods and variables
16 years ago
orbiter 99fa265e1d fix for search bug caused by tenant patch
16 years ago
orbiter 57af311627 fix for wrong urls in navigator when a tenant is used
16 years ago
orbiter be1c7ddc64 refactoring of search classes -- moved Ranking Profile to search package
16 years ago
orbiter b5bc399cea added necessary synchronization for logging statistics (causes deadlock)
16 years ago
orbiter ce1adf9955 serialized all logging using concurrency:
16 years ago
orbiter bc6dd8194b refactoring: moved search query class to new search package
16 years ago
apfelmaennchen 303ccda69f small fix for "did you mean"
16 years ago
orbiter 7c4d1d471c hand-over of more specific object
16 years ago
apfelmaennchen 9150bc0f7d - don't show empty "did you mean"
16 years ago
apfelmaennchen 09acfa66d1 - improved "did you mean"
16 years ago
apfelmaennchen 54a48b4184 - added "did you mean" to search page
16 years ago
orbiter 733385cdd7 enahnced database access times by removal of unnecessary synchronization.
16 years ago
orbiter 27fa6a66ad - completed the author navigation
16 years ago
orbiter c879783008 added steering of navigator computation:
16 years ago
orbiter c079b18ee7 - refactoring of IntegerHandleIndex and LongHandleIndex: both classes had been merged into the new HandleMap class, which handles (key<byte[]>,n-byte-long) pairs with arbitraty key and value length. This will be useful to get a memory-enhanced/minimized database table indexing.
16 years ago
orbiter a0c53abbe1 - wait until local results are computed during search, see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2167&hilit=&p=15521#p15521
16 years ago
orbiter 1c77db670f re-designed response format for navigation:
16 years ago
orbiter a5d481eab1 enhanced navigation
16 years ago
orbiter 88426912ad more refactoring to make the segment object easier to use and to be prepared to integrate author navigation
16 years ago
orbiter 99bf0b8e41 refactoring of plasmaWordIndex:
16 years ago
orbiter 63a0255166 - refactoring: added new content package, which will contain connector classes for different types of data sources to import texts into the YaCy index
16 years ago
orbiter f246928c20 first attempt to add 'real' Navigation to yacy search results: host navigation
16 years ago
orbiter a642d6a7b5 - added navigation icons for search result pages
16 years ago
lotus 0e01e846ef small fix
16 years ago
lotus d8fca85c11 fixed search: allow dots in operators
16 years ago
orbiter 1b8d346b4c fixes in connection with transiton to byte[] hashes
16 years ago
orbiter c8624903c6 full redesign of index access data model:
16 years ago
orbiter 12d81e98eb - fixed bad search results when searching for empty string
16 years ago
orbiter c2359f20dd refactoring: better abstraction of reference and metadata prototypes.
16 years ago
orbiter 7ba078daa1 - added fast site-operator
16 years ago
orbiter 587838bd09 git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5758 6c8d7289-2bf4-0310-a012-ef5d649a1542
16 years ago
orbiter 83792d9233 more refactoring
16 years ago
orbiter 209f25f5f5 refactoring to integrate indexCell data structures
16 years ago
orbiter 7f67238f8b refactoring of plasmaWordIndex: less methods in the class, separated the index to CachedIndexCollection
16 years ago
orbiter 14a1c33823 refactoring of wordIndex class
16 years ago
orbiter e2e7949feb replaced old PPM computation with a better one that simply sums up events that had been stored in the profiling table.
16 years ago
apfelmaennchen 4f3bdc64b5 - added ?callback= parameter for JsonP support
16 years ago
orbiter aa44d9bad9 more refactoring of kelondro.text / deleted de.anomic.index
16 years ago
orbiter 6ffc6e3389 more refactoring of indexer and kelondro classes;
16 years ago
orbiter 76ef5f0f14 refactoring of index package: better names for the classes (to be continued)
16 years ago
orbiter c25c334b75 replaced old DHT transmission method with new method. Many things have changed! some of them:
16 years ago
orbiter 86763c42c4 enhanced interactive search
16 years ago
orbiter 9d282d2c16 - renamed interactivesearch to yacyinteractive
16 years ago
orbiter ef82cced01 removed default line 'P2P WEB SEARCH' if no line is given
16 years ago
orbiter 94110df85a moved logging partially to kelondro
16 years ago
orbiter 024da2916b refactoring of logging
16 years ago
orbiter 83ce65707a (almost) completed partition of classes in kelondro
16 years ago
orbiter 7ee494fde5 more refactoring of kelondro:
16 years ago
orbiter bf93767ec6 refactoring of kelondro database classes
16 years ago
orbiter fc27bf8c4c refactoring of kelondro classes:
16 years ago
low012 b41a06228f *) cleaning up...
16 years ago
low012 ce81391095 *) using parameters like site: in the search field does not affect urlmask anymore
16 years ago
low012 80e6356860 *) r 5512 has introduced a bug which resulted in useless filters if site:, filtetype:, or inurl: was used since the filters included the word "null".
16 years ago
lotus 5078e837ac better readability / no functional changes
16 years ago
lotus c7c291bc6b allow simultaneous inurl: site: and filetype: search
16 years ago
orbiter 9ef77d57f5 added an access control to the search interface using white/blacklists:
16 years ago
lotus 4641ecd6d9 inurl: search
16 years ago
lotus 0d1bd78674 * full site: syntax support e.g. site:de.wikipedia.org
16 years ago
orbiter 9bed4de280 fix for the search bug introduced in SVN 5449
16 years ago
orbiter b2b7edae18 fixed interactive search
16 years ago
lotus ca80930892 accept leading dots on filetype: and site: search
16 years ago
low012 1af728ae09 *) regex for site operator changed as proposed by Lotus
16 years ago
low012 9e58ae036d *) added site operator which can be used to only show results from a certain domain. example: "test site:edu" shows only documents which contain the word test and which come from an edu domain
16 years ago
orbiter 28d2d28573 added support for filetype search
16 years ago
orbiter 47292e696a more performance hacks
16 years ago
orbiter d39d420b39 performance hacks
16 years ago
orbiter 0b4808ba3d added new interactive search feature:
16 years ago
lotus 1951d30a62 addendum to last commit
16 years ago
orbiter 0edec2b760 FULL redesign of algorithms in htmlTools to encode/decode strings from/to unicode and html.
16 years ago
low012 77e41da7d2 *) further propagation of display value (see http://forum.yacy-websuche.de/viewtopic.php?f=5&t=1536)
16 years ago
lotus 7782a43060 fix if LANGUAGE: was not defined and the end of the query
16 years ago
lotus fe2792e9ce use accept-language header instead of user agent for language detection
16 years ago
lotus 93ddf206e6 opensearch fix if user agent had no language
16 years ago
orbiter 6e7d113eac fix for wrong index initialization after network switch
16 years ago
orbiter 1198eeecc7 added language selection to search query:
16 years ago
orbiter 00c1535f84 added ranking and evaluation of language type in a search
16 years ago
orbiter 4fbee21cea - added fetch-ahead again (had been removed in last commit)
16 years ago
orbiter fc03b0437a fixed a error case where a second search after a first search with a different search word failed
16 years ago
orbiter d3d41e2ee4 - fixed problem with searching with quotes (still not complete, but not as bad as before)
16 years ago
lotus 3fbfd5a78b * fix for non-changing offset on new search term
16 years ago
orbiter 536e77e8b7 modifications towards a single database operation to read/write http header and cached file at once:
16 years ago
danielr 621b473b18 * removed some warnings of findbugs (http://findbugs.sf.net)
17 years ago
danielr 17b7845eb5 * refactoring
17 years ago
danielr 3bb870bfcd added final where possible
17 years ago
orbiter c3d461d191 - removed superfluous copyright statement
17 years ago
orbiter 3ca98fee42 removed superfluous copyright statement
17 years ago
danielr d14e8d348f - times of LOCAL_SEARCH are shown in milliseconds (also in yacysearch.java ;)
17 years ago
orbiter b38f467e3c better SRU compliance
17 years ago
orbiter a6719dfd2b - refactoring of robots parser
17 years ago
orbiter 474e29ce4a added options to configure the 'corporate identity'-icons, the home page link and the greeting line from
17 years ago
orbiter c998dc6556 - added security functions to flush url and search caches in case that memory is full
17 years ago
orbiter 994c609cf8 added new shell script to do a web search from the terminal
17 years ago
orbiter f5ef7f222e - fixed a bug in parser (directory paths had not been recognized)
17 years ago
danielr 7feae906aa - organize imports
17 years ago
orbiter b21598bdd0 - enhanced handling of own IP address inside seed
17 years ago
orbiter 2a604b7402 added superfast search result computation which can be obtained for local search when snippet fetching is disabled. An example search for the rss interface would be:
17 years ago
orbiter d8277e6af1 - added parsing of numeric html entities for crawler
17 years ago
orbiter 0c173821fd more access security regarding database access and snippet retrieval: restrict number of results for not-authorized searchers
17 years ago
orbiter 53dfe9fe9a added RECENT command for search query:
17 years ago
orbiter 3aa69dab94 prevent too high search request frequency submitted from the same peer
17 years ago
orbiter cfe6790498 - added option to switch between yacy networks, especially between the two default networks (freeworld and intranet),
17 years ago
lotus 9bc56a9edc xss protection
17 years ago
orbiter b32736762c enhanced rssTerminal
17 years ago
orbiter d2ba1fd2ab major step forward to network switching (target is easy switch to intranet or other networks .. and back)
17 years ago
orbiter e024e3b9cf added new default profiles to distinguish snippet fetch for local and global search
17 years ago
orbiter 2c0c8f0f0c SRU compliance according to
17 years ago
orbiter 7f9f639d20 - refactoring and abstraction of index reference (urls) handling: blacklisting is part of reference filtering
17 years ago
orbiter d6050b9ffb - separated the LURL data storage and Crawl result stack for process supervision.
17 years ago
orbiter 93633abed8 - removed some debugging code from search process - should speed up now
17 years ago
orbiter 541b817502 refactoring of switchboard queueing
17 years ago
orbiter b4ed937f1e - modified zone navigation (does still not work correctly)
17 years ago
orbiter a7abee3578 - fixed some data types in new search stack
17 years ago
orbiter 61a81820e3 - refactoring of search tracker
17 years ago
orbiter bd63999801 - faster search: using different data structures that avoid multiplr calculations
17 years ago
orbiter 159aaf8889 re-introduced global search limitation when index receive is switched off
17 years ago
orbiter 3c7b94c119 - fix for online caution delay settings, see
17 years ago
orbiter a1e9e6e2e6 fix for search result page navigation
17 years ago
orbiter 7404256997 - no more search time-out!
17 years ago
orbiter a8a5df4a51 - more dublin core naming of page metadata
17 years ago
orbiter efd0b8371a - added parsing of Dublin Core - compliant metadata (see RFC 5013 and ISO 15836) to html parser
17 years ago
orbiter 45339c3db5 more generics
17 years ago
orbiter a5054c038d - added large number of generics
17 years ago
orbiter ecd7f8ba4e - added NEAR operator (must be written in UPPERCASE in search query)
17 years ago
orbiter 270d016d89 fix for missing anonymization in search profiling
17 years ago
orbiter 5185acaf41 - reduced default search time
17 years ago
orbiter f243e338cf implemented online caution also for local and remote search
17 years ago
orbiter 6680634703 removed unnecessary functions
17 years ago
orbiter b46bcaa5d8 changed method of profiling
17 years ago
orbiter 2fcd18a972 - fixed bad behaviour of search event worker processes
17 years ago
orbiter 445c0b5333 added domain list extraction and html export format
17 years ago
orbiter c48b73cda2 redesign of ranking data structure
17 years ago
orbiter 6f1308da2f - some enhancements to IndexControlURLs (shows more links, connects referrer to another query)
17 years ago
orbiter c527969185 - enhanced monitoring of ranking parameters
17 years ago
orbiter 6eaa5a0e64 enhanced local search speed. The ranking process is now 6 times faster that before.
17 years ago
fuchsi 0e1738899f * Complete number localization and provide a more reasonable interface to serverObjects:
17 years ago
orbiter 9d539ec621 added option to display the network name as page greeting instead the page greeting string
17 years ago
fuchsi ebfd1e0b42 remove left over '>' in description and replace ' ' by '+' in rss search where URL-encoded parameters are required.
17 years ago
fuchsi ed20531e68 don't encode in channel element as well
17 years ago
fuchsi c5a8585ac6 fix more encooding problems in yacysearch.rss.
17 years ago
fuchsi 03c5b4ad68 more fixes to the yacysearch.rss, it's now 100% valid according to http://feedvalidator.org
17 years ago
orbiter b183bf6f42 - fixed opensearch bugs
17 years ago
orbiter 01e0669264 re-designed some parts of DHT position calculation (effect is the same as before)
17 years ago
orbiter 341f7cb327 steps to enhance remote search performance:
17 years ago
fuchsi 9524b9c16a second try of rev 4100 :). Tested in Iceweasel/Firefox 2.0.6, Konqueror 3.5.7, Opera 9.23 (all linux) and IE6-SP1 (wine)
17 years ago
orbiter 229ca2ba48 fixed/re-implemented rss-version of search result page
17 years ago
orbiter 8ff5e2c283 - fixed/re-implemented media search
17 years ago
orbiter 6c3bcadc1c - re-implemented image search
17 years ago
orbiter daf0f74361 joined anomic.net.URL, plasmaURL and url hash computation:
17 years ago
orbiter e90afa9483 fixed search access tracker
17 years ago
orbiter 4779f314fe first version of next-generation search interface:
17 years ago
orbiter f9e6cf6a3d more refactoring of search:
17 years ago
orbiter e332b844b2 - enhanced remote search: during waiting time for remote crawls
17 years ago
orbiter a34d9b8609 * added a search history cache that maintains search results for 10 minutes
17 years ago
orbiter ae86d010bb more refactoring of search processes; also some small speed enhancements
17 years ago
orbiter 947fc46904 refactoring of search process:
18 years ago
orbiter 5605887571 refactoring of search processes
18 years ago
orbiter 62347b50f4 added security layer for ViewImage:
18 years ago
orbiter 9ca46a8c69 indexing of local (intranet) urls enabled
18 years ago
orbiter 40b0547611 - documentaton changes (removed old forum links)
18 years ago
orbiter 98b97161d3 fix for uncatched news record exception
18 years ago
orbiter 7c5c814a47 - simplified code (removed exception handling where not necessary)
18 years ago
orbiter a45216b479 fix to prevent bad-formed news messages
18 years ago
orbiter 815e3da62f fix for http://www.yacy-forum.de/viewtopic.php?p=37353#37353
18 years ago
allo d8951422f9 favicons ;)
18 years ago
rramthun 18a5380ee3 *) situation-dependent lock-buttons for search-page
18 years ago
theli 051a65f7af *) Snippet fetching:
18 years ago
orbiter b3d2fafcfb added option to block the search function against unauthorized users
18 years ago
orbiter e48189c710 enhanced cluster routing
18 years ago
orbiter f73e1e3af9 fixed bugs in remote search setting for public clusters
18 years ago
orbiter e192f616a2 collection of small bugfixes
18 years ago
orbiter f8de19fb2f robinson cluster: added client-side protocol implementation
18 years ago
orbiter 89c1511738 - added new Network Configuration menu, can be found in basic settings
18 years ago
michitux e917bfcae3 * Bugfix: changed handling of the query-string to be independent from input-elements
18 years ago
orbiter 45f4489f4b bugfix for broken media search
18 years ago
orbiter 3e5cd34229 update to search display options for kaskelix embedding
18 years ago
orbiter a922d9444d fixed search page (there had been some unresolved patterns)
18 years ago
orbiter d59b31ec0c better display of embedded search results (no more comment on global search, if local was choosen on purpose)
18 years ago
orbiter 4eecf0bb12 templates for embedded display. try:
18 years ago
orbiter 40c14a4f0e - better implementation of search query properties
18 years ago
orbiter 6e7340ef52 added exclusion search
18 years ago
orbiter ba2c307ab3 optimized memory allocation in kelondroRow.Entry
18 years ago
low012 bc37ac64b3 *) Fix for last commit.
18 years ago
low012 f603b58f6c *) No stacktrace anymore if invalid regex is entered for URL mask or Prefer mask, insted an error message gets displayed.
18 years ago
theli 589cbd8cbf *) replacing all yacy-news-category strings with corresponding constants
18 years ago
orbiter 6b9eea3932 - removed differentiation between longTitle and shortTitle; this cannot be used for search results,
18 years ago
orbiter a738b57b31 added author tag to indexing content
18 years ago
orbiter 9f929b5438 better snippet handling in case of snippet load fail
18 years ago
rramthun 045d758537 Avoid stopwords as topwords, configurable
18 years ago
orbiter d25caa07bf redesigned some parts of http authentication
18 years ago
karlchenofhell e68cdeeeb3 - reverted parseArg(String) to use a byte-array to handle correct UTF-8 parsing
18 years ago
allo 16aa66bf3d fix for promoteSearchPageString
18 years ago
orbiter 8369b2bd5a fix for surf tip bug
18 years ago
orbiter c0851ee943 refactoring: moved and renamed de.anomic.data.searchResults to plasma package
18 years ago
allo c39dda2374 finished refactoring of searchtemplates.
18 years ago
allo 0c81bd39d4 XSS-safe put as default.
18 years ago
(no author) fe72b772cf added a monitor page for search requests
18 years ago