Insights into Time and Search Behavior in Information Retrieval
Explore the impact of time on search experiences with studies on response time variations, search session durations, user behaviors influenced by time, and willingness to wait for search results. Discover how different types of searches are affected by response time changes, page load times, and user interaction in the information retrieval process.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
SLOW SEARCH Jaime Teevan, Kevyn Collins-Thompson, Ryen White, Susan Dumais and Yubin Kim
Not All Searches Need to Be Fast Long-term tasks Long search sessions Multi-session searches Social search Question asking Technologically limited Limited connectivity Mobile devices Search from space
TIME + SEARCH Understand how time influences the search experience
Time in Search: Micro Scale Impact of sub-second changes in response time Study using large-scale query log analysis Natural variation exists within a single query Measure interaction as f(response time) Time to click Abandonment rate
Small Increases Big Changes 1.4 1.4 1.3 1.3 Relative Time To Click 1.2 1.2 1.1 1.1 Navigational Informational 1 1 0.9 0.9 500 500 700 700 900 900 1100 1100 1300 1300 1500 1500 Page Load Time (ms)
Impact of Sub-Second Changes Imperceptible changes impact behavior Impact of slower page load time Slower time to click Increased abandonment Some queries more sensitive to time than others Time impacts navigational queries > informational Informational queries less impacted by very slow results 1.4 1.3 1.4 1.3 1.2 1.2 1.1 1.1 0.91 0.91 500 1 700 10 Page Load Time (ms) 900 1100 100 1300 1000 1500 Time Spent Searching (mins)
Time in Search: Macro Scale Impact of longer changes in response time Two user surveys with 1476 participants in total Detailed survey with 141 MSFT employees Online survey with 1335 people Asked about the participant s last search Willingness to wait for results as f(response time) 1.4 1.3 1.2 1.1 0.91 1 10 100 1000 Time Spent Searching (mins)
Last Search Took Minutes or Hours 1.0 Probability of Searching that Long 0.8 0.6 0.4 0.2 0.0 1 10 100 1000 Time Spent Searching (mins)
Time Constraints in Search Reported spending more time on some searches Important tasks Tasks with a deadline Tasks with bad search results Time constraints 34% of tasks needed results urgently 39% of tasks needed results by a deadline 27% of tasks needed results whenever
Willingness to Wait Time willing to wait < actual time spent searching Participants do not trust the search engine 28% people said they want fast results always For important tasks Spent more time searching than less important Willing to wait less than less important
Willing to Wait for Quality Results 1.0 Probability of Searching that Long Perfect Much Better Better Slightly Better 0.8 0.6 0.4 0.2 0.0 1 10 100 1000 Wait Time (mins)
Impact of Longer Intervals of Time People do not want to wait, but Report spending a lot of time on important tasks 90% of the important tasks took more than 1 minute 23% of respondents found their results unacceptable Are willing wait in some cases When the results obtained were poor When a perfect answer is sought
QUESTIONS? Jaime Teevan teevan@microsoft.com Yubin Kim yubink@cmu.edu
