Dear all, I am a student researcher in search and IR. I wanted to study the occasional increase in popularity of queries and associated increase in content generated which are relevant to the query. For example, when Egypt protests occurred, the search engine queries having "Egypt" keyword increased and the related news articles containing "Egypt" also increased.

I believe that search engine query logs as well as associated crawl data are difficult to get. Hence, if there are other resources also giving the same idea, kindly let me know.

Thanks in advance,

Sincerely, Harisankar H

asked 09 Mar '11, 05:39

harisankarh's gravatar image

accept rate: 0%

You can get a vague idea of the relative volumes of different searches on Google web search from Google Trends and Google Insights for Search. Google Trends also gives an indication of the volume of news stories relating to a particular search term, and an option to export the data as CSV. I'm not sure how the data is licensed for use though?

The Guardian Platform API also provides a basis for discovering the number of news stories on a particular topic published by the Guardian. For example, see the Guardian Trends mashup.

Trendistic allows you to plot the volume of updates mentioning specified terms on Twitter, but I don't know of any similar tools that show the volume of searches by term on Twitter.


answered 09 Mar '11, 11:01

psychemedia's gravatar image

psychemedia ♦♦
accept rate: 11%

Thanks psychemedia for the reply. Google trends seems like a very good option. But, the problem with Google trends is that it is giving query/news reference volumes relative to the specified keywords only(even with fixed scaling). I want to get an idea about how the query/reference popularity changed in absolute terms eg. x queries/sec to y queries/sec within z minutes/secs. As you mentioned, it is difficult to use Guardian and Trendistic data as they give only the content info, not of queries. In my particular case, I need both. Please give more hints if possible. Thanks again!

(09 Mar '11, 11:22) harisankarh

By the by, I just spotted this analysis of time series data from Google Insights for Search using R: eBooks in Education - Looking at Trends [ ]

It seems that Google Insights for search does have a data export option too - a Download as CSV link at the top right of the page.

(11 Mar '11, 12:42) psychemedia ♦♦
Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here



Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text]( "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported



Asked: 09 Mar '11, 05:39

Seen: 723 times

Last updated: 14 Jun, 04:15

powered by OSQA