Searching in the Tower of Babel

You may have noticed on this blog that I’ve been busy with a number of things just recently, but I’m pleased to report that we’ve been continuing to add useful features to 2dSearch, and one of them in particular deserves a shout out here.

As you may know, many professions need to perform searches that are comprehensive, accurate and repeatable, using strategies that search across multiple databases with platform-specific syntax and operators. For example, a recruiter looking to fill a particular data science role may want to search LinkedIn, Stackoverflow, Github, and other social forums to find suitable candidates. Likewise, a clinician or information professional performing a systematic literature review may need to search numerous databases such as PubMed, Embase, Web of Science, PyscINFO, and more. In each case, their search query has to be manually ‘translated’ to the syntax and user interface of each database. All of this is tedious, error-prone, and inefficient.

Advertisements

Read Full Post »

Rethinking ‘Advanced Search’: A New Approach to Complex Query Formulation

I am delighted to announce publication of our latest open-access scholarly paper ‘Rethinking ‘Advanced Search’: A New Approach to Complex Query Formulation‘, which has just been published in the proceedings of the 41st European Conference on Information Retrieval (ECIR) in Cologne. This work is a collaboration with Jon Chamberlain and Udo Kruschwitz of Essex University, and accompanies our demo at the event.

The paper focuses on the application of query visualisation to structured searching and in particular the challenges associated with the recruitment profession, and hopefully complements some of the more opinion or design-oriented posts on this site. I’ve appended the abstract below. For free access to a copy, visit the ECIR website.

Read Full Post »

A Visual Approach to Query Formulation for Systematic Search

I am delighted to announce publication of our latest open-access scholarly paper ‘A Visual Approach to Query Formulation for Systematic Search‘, which has just been published in the proceedings of the 4th ACM SIGIR Conference on Human Information Interaction and Retrieval. This work is a collaboration with Jon Chamberlain of Essex University and Farhad Shokraneh of Nottingham University, and accompanies our demo at the event.

The paper focuses on the application of query visualisation to healthcare information, and hopefully complements some of the more opinion or design-oriented posts on this site. I’ve appended the abstract below. For free access to a copy, visit the ACM Digital Library.

Read Full Post »

Google Scholar: not so smart?

Most of us are familiar Google Scholar: a freely available subset of Google that indexes the world’s scholarly literature across a range of disciplines. With its database of over 389 million documents including articles, citations and patents, it has become an indispensable resource for scholars and researchers across the globe. Which is why we recently added Google Scholar integration to 2dSearch, thereby offering a tool of immediate utility to anyone wishing to search the world’s scientific literature in a systematic manner.

Now, we’d always known that despite its extensive index, searching GS is subject to the ‘secret sauce’ of Google’s search algorithms, and that this can compromise the ability of users to formulate sophisticated, reproducible searches. But what we perhaps didn’t realise was just how limited that support is. In particular, GS seems to support only 1 set of synonyms (i.e. a substring with terms separated by OR). For example, the following search string would seem to parse correctly:

Read Full Post »

The snakes and ladders of search query formulation

If you were tasked with designing a universal framework for search query formulation, where would you start? Well, you could start from a command-line paradigm. After all, that’s the approach adopted by most query builders and ‘advanced search’ forms. But convention aside, is that really the best place to start? Personally, I am not convinced – IMHO command line approaches reflect the days when searches were conducted via remote terminals to subscription databases, and in that respect, they represent the past, not the future. Moreover, using Boolean strings to articulate complex information needs suffers from a number of fundamental shortcomings, in particular regarding scalability, efficiency and transparency. So what’s the alternative?

Read Full Post »

Towards transparency in systematic searching

A couple of days ago I published a piece on Medium called “Searching PubMed just got smarter“, in which I talked about how we’ve added PubMed integration to 2dSearch, thereby offering a tool of immediate utility to anyone wishing to search MEDLINE in a systematic manner. The service has only been live a week or two, but the post did seem to strike a chord with a number of people. And some of that commentary got me thinking about various issues around reproducibility (with regard both to scientific research and to searching methodologies). But it also raised an issue around transparency, and the degree to which the formalisms we use to express information needs can scale to accommodate new use cases and requirements.

Read Full Post »

A universal framework for information needs

A couple of days ago I published a piece on Medium called “Towards a universal language for search“, in which I talked about how we’ve added Google integration to 2dSearch, thereby allowing a user to apply the same search strategy (or Boolean string) to search multiple databases. Of course, this may not matter much to your ‘average web searcher’, but for some professions, this is a big thing. Now the point isn’t so much about Google (or Bing for the matter), that just happens to be the instance we have used to illustrate the concept. And crucially, the point isn’t about query languages either (in the programmatic sense) – important though they are, converting a user’s information need into a API call is a different problem.

Instead, what we’re contemplating here is the prospect of a universal framework for information needs. 

Read Full Post »