Author(s):

  • Nediyana Daskalova
  • Eindra Kyi
  • Kevin Ouyang
  • Arthur Borem
  • Sally Chen
  • Sung Hyun Park
  • Nicole Nugent
  • Jeff Huang

Abstract:

The ubiquity of self-tracking devices and smartphone apps has empowered people to collect data about themselves and try to self-improve. However, people with little to no personal analytics experience may not be able to analyze data or run experiments on their own (self-experiments). To lower the barrier to intervention-based self-experimentation, we developed an app called Self-E, which guides users through the experiment. We conducted a 2-week diary study with 16 participants from the local population and a second study with a more advanced group of users to investigate how they perceive and carry out self-experiments with the help of Self-E, and what challenges they face. We find that users are influenced by their preconceived notions of how healthy a given behavior is, making it difficult to follow Self-E’s directions and trusting its results. We present suggestions to overcome this challenge, such as by incorporating empathy and scaffolding in the system.

Documentation:

https://doi.org/10.1145/3411764.3445100

References:
  1. Amid Ayobi, Paul Marshall, and Anna L Cox. 2020. Trackly: A Customisable and Pictorial Self-Tracking App to Support Agency in Multiple Sclerosis Self-Care. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, 1–15.
  2. Amid Ayobi, Paul Marshall, Anna L Cox, and Yunan Chen. 2017. Quantifying the body and caring for the mind: self-tracking in multiple sclerosis. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 6889–6901.
  3. Amid Ayobi, Tobias Sonne, Paul Marshall, and Anna L Cox. 2018. Flexible and Mindful Self-Tracking: Design Implications from Paper Bullet Journals. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 28.
  4. Colin Barr, Maria Marois, Ida Sim, Christopher H Schmid, Barth Wilsey, Deborah Ward, Naihua Duan, Ron D Hays, Joshua Selsky, Joseph Servadio, 2015. The PREEMPT study-evaluating smartphone-assisted n-of-1 trials in patients with chronic pain: study protocol for a randomized controlled trial. Trials 16, 1 (2015), 67.
  5. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.
  6. Colleen E Carney, Daniel J Buysse, Sonia Ancoli-Israel, Jack D Edinger, Andrew D Krystal, Kenneth L Lichstein, and Charles M Morin. 2012. The consensus sleep diary: standardizing prospective sleep self-monitoring. Sleep 35, 2 (2012), 287–302.
  7. Ting-Ray Chang, Eija Kaasinen, and Kirsikka Kaipainen. 2012. What influences users’ decisions to take apps into use?: A framework for evaluating persuasive and engaging design in mobile Apps for well-being. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia. ACM.
  8. Connie Chen, David Haddad, Joshua Selsky, Julia E Hoffman, Richard L Kravitz, Deborah E Estrin, and Ida Sim. 2012. Making sense of mobile health data: an open architecture to improve individual-and population-level health. Journal of medical Internet research 14, 4 (2012), e112.
  9. Eun Kyoung Choe, Bongshin Lee, Haining Zhu, Nathalie Henry Riche, and Dominikus Baur. 2017. Understanding self-reflection: how people reflect on personal data through visual data exploration. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare. ACM, 173–182.
  10. Eun Kyoung Choe, Nicole B Lee, Bongshin Lee, Wanda Pratt, and Julie A Kientz. 2014. Understanding quantified-selfers’ practices in collecting and exploring personal data. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1143–1152.
  11. Chia-Fang Chung, Elena Agapie, Jessica Schroeder, Sonali Mishra, James Fogarty, and Sean A Munson. 2017. When personal tracking becomes social: Examining the use of Instagram for healthy eating. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1674–1687.
  12. John Concato, Nirav Shah, and Ralph I Horwitz. 2000. Randomized, controlled trials, observational studies, and the hierarchy of research designs. New England journal of medicine 342, 25 (2000), 1887–1892.
  13. Felicia Cordeiro, Elizabeth Bales, Erin Cherry, and James Fogarty. 2015. Rethinking the mobile food journal: Exploring opportunities for lightweight photo-based capture. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 3207–3216.
  14. Felicia Cordeiro, Daniel A Epstein, Edison Thomaz, Elizabeth Bales, Arvind K Jagannathan, Gregory D Abowd, and James Fogarty. 2015. Barriers and negative nudges: Exploring challenges in food journaling. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 1159–1162.
  15. Mary Czerwinski, Eric Horvitz, and Susan Wilhite. 2004. A diary study of task switching and interruptions. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 175–182.
  16. Nediyana Daskalova, Karthik Desingh, Alexandra Papoutsaki, Diane Schulze, Han Sha, and Jeff Huang. 2017. Lessons learned from two cohorts of personal informatics self-experiments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 46.
  17. Nediyana Daskalova, Danaë Metaxa-Kakavouli, Adrienne Tran, Nicole Nugent, Julie Boergers, John McGeary, and Jeff Huang. 2016. SleepCoacher: A personalized automated self-experimentation system for sleep recommendations. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 347–358.
  18. Nediyana Daskalova, Jina Yoon, Yibing Wang, Cintia Araujo, Guillermo Beltran Jr, Nicole Nugent, John McGeary, Joseph Jay Williams, and Jeff Huang. 2020. SleepBandits: Guided Flexible Self-Experiments for Sleep. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, 1–13.
  19. Orianna DeMasi, Sidney Feygin, Aluma Dembo, Adrian Aguilera, and Benjamin Recht. 2017. Well-being tracking via smartphone-measured activity and sleep: cohort study. JMIR mHealth and uHealth 5, 10 (2017), e137.
  20. Markéta Dolejšová and Denisa Kera. 2017. Soylent Diet Self-Experimentation: Design Challenges in Extreme Citizen Science Projects. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 2112–2123.
  21. Daniel A Epstein, Nicole B Lee, Jennifer H Kang, Elena Agapie, Jessica Schroeder, Laura R Pina, James Fogarty, Julie A Kientz, and Sean Munson. 2017. Examining menstrual tracking to inform the design of personal informatics tools. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 6876–6888.
  22. Daniel A Epstein, An Ping, James Fogarty, and Sean A Munson. 2015. A lived informatics model of personal informatics. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 731–742.
  23. Bob Evans. 2019. PACO: The Personal Analytics Companion. https://pacoapp.com/
  24. Miguel Farias and Catherine Wikholm. 2016. Has the science of mindfulness lost its mind?BJPsych bulletin 40, 6 (2016), 329–332.
  25. Brian J Fogg. 2002. Persuasive technology: using computers to change what we think and do. Ubiquity 2002, December (2002), 5.
  26. Brian J Fogg. 2019. Tiny Habits: The Small Changes That Change Everything. Houghton Mifflin Harcourt.
  27. Susannah Fox and Maeve Duggan. 2013. Tracking for Health. https://www.pewinternet.org/2013/01/28/tracking-for-health/
  28. Daniel Harrison, Paul Marshall, Nadia Bianchi-Berthouze, and Jon Bird. 2015. Activity tracking: barriers, workarounds and customisation. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 617–621.
  29. Eiji Hayashi and Jason Hong. 2011. A diary study of password usage in daily life. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2627–2630.
  30. Steven C Hayes. 1981. Single case experimental design and empirical clinical practice.Journal of consulting and clinical psychology 49, 2(1981), 193.
  31. Reetta Heinonen, Riitta Luoto, Pirjo Lindfors, and Clas-Håkan Nygård. 2012. Usability and feasibility of mobile phone diaries in an experimental physical exercise study. Telemedicine and e-Health 18, 2 (2012), 115–119.
  32. Miguel A Hernán and Sonia Hernández-Díaz. 2012. Beyond the intention-to-treat in comparative effectiveness research. Clinical Trials 9, 1 (2012), 48–55.
  33. Mieke Heyvaert and Patrick Onghena. 2014. Randomization tests for single-case experiments: State of the art, state of the science, and state of the application. Journal of Contextual Behavioral Science 3, 1 (2014), 51–64.
  34. Alexis Hiniker, Sungsoo Ray Hong, Tadayoshi Kohno, and Julie A Kientz. 2016. Mytime: Designing and evaluating an intervention for smartphone non-use. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 4746–4757.
  35. Tero Jokela, Jarno Ojala, and Thomas Olsson. 2015. A diary study on combining multiple information devices in everyday activities and tasks. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 3903–3912.
  36. Ravi Karkar, Jessica Schroeder, Daniel A Epstein, Laura R Pina, Jeffrey Scofield, James Fogarty, Julie A Kientz, Sean A Munson, Roger Vilardaga, and Jasmine Zia. 2017. Tummytrials: a feasibility study of using self-experimentation to detect individualized food triggers. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 6850–6863.
  37. Ravi Karkar, Jasmine Zia, Roger Vilardaga, Sonali R Mishra, James Fogarty, Sean A Munson, and Julie A Kientz. 2015. A framework for self-experimentation in personalized health. Journal of the American Medical Informatics Association 23, 3(2015), 440–448.
  38. Joseph Jofish Kaye, Mary McCuistion, Rebecca Gulotta, and David A Shamma. 2014. Money talks: tracking personal finances. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 521–530.
  39. Christina Kelley, Bongshin Lee, and Lauren Wilcox. 2017. Self-tracking for mental wellness: understanding expert perspectives and student experiences. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 629–641.
  40. John M Kelley and Ted J Kaptchuk. 2010. Group analysis versus individual response: the inferential limits of randomized controlled trials. Contemporary clinical trials 31, 5 (2010), 423–428.
  41. Ian Kerridge. 2003. Altruism or reckless curiosity? A brief history of self experimentation in medicine. Internal medicine journal 33, 4 (2003), 203–207.
  42. Elisabeth T Kersten-van Dijk, Joyce HDM Westerink, Femke Beute, and Wijnand A IJsselsteijn. 2017. Personal informatics, self-insight, and behavior change: A critical review of current literature. Human–Computer Interaction 32, 5-6 (2017), 268–296.
  43. Julie A Kientz. 2019. In Praise of Small Data: When You Might Consider N-of-1 Studies. GetMobile: Mobile Computing and Communications 22, 4(2019), 5–8.
  44. Young-Ho Kim, Eun Kyoung Choe, Bongshin Lee, and Jinwook Seo. 2019. Understanding Personal Productivity: How Knowledge Workers Define, Evaluate, and Reflect on Their Productivity. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 615.
  45. Young-Ho Kim, Jae Ho Jeon, Eun Kyoung Choe, Bongshin Lee, KwonHyun Kim, and Jinwook Seo. 2016. TimeAware: Leveraging framing effects to enhance personal productivity. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 272–283.
  46. Young-Ho Kim, Jae Ho Jeon, Bongshin Lee, Eun Kyoung Choe, and Jinwook Seo. 2017. OmniTrack: A Flexible Self-Tracking Approach Leveraging Semi-Automated Tracking. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 67.
  47. Judy Kopp. 1988. Self-monitoring: A literature review of research and practice. In Social Work Research and Abstracts, Vol. 24. Oxford University Press, 8–20.
  48. Thomas R Kratochwill, John H Hitchcock, Robert H Horner, Joel R Levin, Samuel L Odom, David M Rindskopf, and William R Shadish. 2013. Single-case intervention research design standards. Remedial and Special Education 34, 1 (2013), 26–38.
  49. Reed Larson and Mihaly Csikszentmihalyi. 2014. The experience sampling method. In Flow and the foundations of positive psychology. Springer, 21–34.
  50. Gary P Latham. 2003. Goal setting: A five-step approach to behavior change.Organizational Dynamics(2003), 309–318.
  51. Jisoo Lee, Erin Walker, Winslow Burleson, Matthew Kay, Matthew Buman, and Eric B Hekler. 2017. Self-experimentation for behavior change: Design and formative evaluation of two approaches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 6837–6849.
  52. Ian Li, Anind Dey, and Jodi Forlizzi. 2010. A stage-based model of personal informatics systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 557–566.
  53. Elizabeth O Lillie, Bradley Patay, Joel Diamant, Brian Issell, Eric J Topol, and Nicholas J Schork. 2011. The n-of-1 clinical trial: the ultimate strategy for individualizing medicine?Personalized medicine 8, 2 (2011), 161–173.
  54. David Mant. 1999. Can randomised trials inform clinical decisions about individual patients?The Lancet 353, 9154 (1999), 743–746.
  55. Sean A Munson, Jessica Schroeder, Ravi Karkar, Julie A Kientz, Chia-Fang Chung, and James Fogarty. 2020. The Importance of Starting With Goals in N-of-1 Studies. Frontiers in Digital Health 2 (2020), 3.
  56. Gina Neff and Dawn Nafus. 2016. Self-tracking. MIT Press.
  57. Rosemery O Nelson and Steven C Hayes. 1981. Theoretical explanations for reactivity in self-monitoring. Behavior Modification 5, 1 (1981), 3–14.
  58. Doug Oman, Shauna L Shapiro, Carl E Thoresen, Thomas G Plante, and Tim Flinders. 2008. Meditation lowers stress and supports forgiveness among college students: A randomized controlled trial. Journal of American College Health 56, 5 (2008), 569–578.
  59. Leysia Palen and Marilyn Salzman. 2002. Voice-mail diary studies for naturalistic data capture under mobile conditions. In Proceedings of the 2002 ACM conference on Computer supported cooperative work. ACM, 87–95.
  60. Vineet Pandey. 2018. Creating Scientific Theories with Online Communities using Gut Instinct. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing. 109–112.
  61. Vineet Pandey, Tushar Koul, Chen Yang, Daniel McDonald, Mad Price Ball, Bastian Greshake Tzovaras, and Scott Klemmer. 2021. Galileo: Citizen-led Experimentation using a Social Computing System. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM.
  62. Sun Young Park and Yunan Chen. 2015. Individual and social recognition: challenges and opportunities in migraine management. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 1540–1551.
  63. James O Prochaska and Wayne F Velicer. 1997. The transtheoretical model of health behavior change. American journal of health promotion 12, 1 (1997), 38–48.
  64. Seth Roberts and Allen Neuringer. 1998. Self-experimentation. In Handbook of research methods in human operant behavior. Springer, 619–655.
  65. John Rooksby, Parvin Asadzadeh, Mattias Rost, Alistair Morrison, and Matthew Chalmers. 2016. Personal tracking of screen time on digital devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 284–296.
  66. John Rooksby, Mattias Rost, Alistair Morrison, and Matthew Chalmers. 2014. Personal tracking as lived informatics. In Proceedings of the 2014 CHI Conference on Human Factors in Computing Systems. ACM, 1163–1172.
  67. Daniel J Russo, Benjamin Van Roy, Abbas Kazerouni, Ian Osband, Zheng Wen, 2018. A tutorial on Thompson sampling. Foundations and Trends® in Machine Learning 11, 1(2018), 1–96.
  68. Johnny Saldaña. 2015. The coding manual for qualitative researchers. Sage.
  69. Akane Sano, Sara Taylor, Craig Ferguson, Akshay Mohan, and Rosalind W Picard. 2017. QuantifyMe: An Automated Single-Case Experimental Design Platform. In International Conference on Wireless Mobile Communication and Healthcare. Springer, 199–206.
  70. Jessica Schroeder, Chia-Fang Chung, Daniel A Epstein, Ravi Karkar, Adele Parsons, Natalia Murinova, James Fogarty, and Sean A Munson. 2018. Examining self-tracking by people with migraine: goals, needs, and opportunities in a chronic health condition. In Proceedings of the 2018 on Designing Interactive Systems Conference 2018. ACM, 135–148.
  71. Jessica Schroeder, Ravi Karkar, James Fogarty, Julie A Kientz, Sean A Munson, and Matthew Kay. 2019. A Patient-Centered Proposal for Bayesian Analysis of Self-Experiments for Health. Journal of healthcare informatics research 3, 1 (2019), 124–155.
  72. Timothy Sohn, Kevin A Li, William G Griswold, and James D Hollan. 2008. A diary study of mobile information needs. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 433–442.
  73. Katarzyna Stawarz, Anna L Cox, and Ann Blandford. 2015. Beyond self-tracking and reminders: designing smartphone apps that support habit formation. In Proceedings of the 33rd annual ACM conference on Human Factors in Computing Systems. ACM, 2653–2662.
  74. Anselm Strauss and Juliet Corbin. 1998. Basics of qualitative research techniques. Sage publications Thousand Oaks, CA.
  75. Melanie Swan. 2013. The quantified self: Fundamental disruption in big data science and biological discovery. Big data 1, 2 (2013), 85–99.
  76. Jakob Tholander and Maria Normark. 2020. Crafting Personal Information-Resistance, Imperfection, and Self-Creation in Bullet Journaling. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
  77. Eric Topol. 2019. The A.I. Diet. The New York Times (Mar 2019). https://www.nytimes.com/2019/03/02/opinion/sunday/diet-artificial-intelligence-diabetes.html
  78. Niels van Berkel, Jorge Goncalves, Peter Koval, Simo Hosio, Tilman Dingler, Denzil Ferreira, and Vassilis Kostakos. 2019. Context-Informed Scheduling and Analysis: Improving Accuracy of Mobile Self-Reports. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 1–12.
  79. Heather P Whitley and Wesley Lindsey. 2009. Sex-based differences in drug activity. American family physician 80, 11 (2009), 1254–1258.
  80. Steve Whittaker, Vaiva Kalnikaite, Victoria Hollis, and Andrew Guydish. 2016. ‘Don’t Waste My Time’: Use of Time Information Improves Focus. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1729–1738.
  81. Hanlu Ye, Meethu Malu, Uran Oh, and Leah Findlater. 2014. Current and future mobile and wearable device use by people with visual impairments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3123–3132.