Relevance criteria for health information on a health discussion forum: An analysis of user eye movements
Pian, W., Khoo, C.S.G., & Chang, Y.K. (2016). The criteria people use in relevance decisions on health information: An analysis of user eye movements when browsing a health discussion forum. Journal of Medical Internet Research, 18(6):e136. (Available at: http://www.jmir.org/2016/6/e136/)
Background: People are increasingly accessing health-related social media sites, such as health discussion forums, to post and read user-generated health information. It is important to know what criteria people use when deciding the relevance of information found on health social media websites, in different situations.
Objective: The study attempted to identify the relevance criteria that people use when browsing a health discussion forum, in 3 types of use contexts: when seeking information for their own health issue, when seeking for other people’s health issue, and when browsing without a particular health issue in mind.
Method: A total of 58 study participants were self-assigned to 1 of the 3 information need contexts and were asked to browse a health discussion forum, HealthBoards.com. In the analysis, browsing a discussion forum was divided into 2 stages: scanning a set of post surrogates (mainly post titles) in the summary result screen and reading the post content (including comments by other users) in the detailed result screen. An eye tracker system was used to capture participants’ eye movement behavior and the text they skim over and focus (i.e. fixate) on during browsing. By analyzing the text that people’s eyes fixated on, the types of health information used in the relevance judgment were determined. Post-experiment interviews elicited participants’ comments on the relevance of the information and criteria used.
Results: It was found that participants seeking information for their own health issue focused significantly more on the poster’s symptoms, personal history of the disease, and description of the disease. Participants seeking for other people’s health issue focused significantly more on cause of disease, disease terminology, and description of treatments and procedures. In contrast, participants browsing with no particular issue in mind focused significantly more on general health topics, hot topics, and rare health issues.
Conclusion: Users browsing for their own health issue used mainly case-based relevance criteria to relate the poster’s health situation to their own. Participants seeking for a relative or friend’s health issue used mostly general knowledge–based criteria, whereas users with no particular issue in mind used general interest and curiosity-based criteria.