Lorcan Dempsey's weblog On libraries, services and networks.   

Hwaet! Such swift search, SRU on a cluster

 •  Categories: General - systems and technologies , Libraries - distributed environments , OCLC , Search

My colleagues write about parallel text searching on a Beowulf Cluster in the current DLib Magazine:

This article describes our experience building a scalable, relatively inexpensive, and fast searching framework that demonstrated 172 searches per second on a database of 50 million records. The article should be of interest to anyone seeking an inexpensive, open source, text-searching framework that scales to extremely large databases. The technology described uses the SRW (Search/Retrieve Web) service in a manner nearly identical to federated searching in the metasearch community and should be of interest to anyone doing federated searching. [Parallel Text Searching on a Beowulf Cluster using SRW]
And a topical conclusion:
There is reason to be concerned about the efficiency of SRW and SOAP-based Web Services as opposed to SRU and REST-style services, at least in high-throughput multi-threaded clients. [Parallel Text Searching on a Beowulf Cluster using SRW]

Bookmark:  del.icio.us   Digg This   Google Boomarks   reddit   Furl  

0 comments so far

Post a commentPost a comment

Remember me? 
(You may use HTML tags for style)
  
Syndication
AddThis Feed Button Atom Feed RSS Feed 1.0 RSS Feed 2.0
email.gif Weekly digest Enter email for digest
Irish Blog Directory
Find In A Library
Search for an item in libraries near you: