How does fitbit measure brainwaves”: A qualitative study into the credibility of sleep-tracking technologies

by | Mar 18, 2020 | Research Publications

Author(s):

  • Zilu Liang
  • Bernd Ploderer

Abstract:

Consumer sleep-tracking devices provide an unobtrusive and affordable way to learn about personal sleep habits. Recent research focused primarily on the information provided by such devices, i.e., whether the information is accurate and meaningful to people. However, little is known about how people judge the credibility of such information, and how the functionality and the design may influence such judgements. Hence, the aim of this research was to examine how consumers assess the credibility of sleep-tracking devices. We conducted a qualitative study with 22 participants who tracked their sleep for 3 nights with three different devices: Fitbit Charge 2, Neuroon EEG, and SleepScope, a medical sleep monitor. Based on semi-structured interviews, we found that people assess the credibility of sleep-tracking devices based not only on the credibility of sleep data per se, but also on device functionality, interface design and physical appearance. People found it difficult to judge credibility, because of the complexities of sleep stages and micro-arousals (sleep fallacy) and the black boxed nature of devices (black box fallacy), and also because of the misalignment between objective sleep measures and subjective sleep quality. We discuss the significance of design and functionality on the credibility of personal health technologies and highlight design challenges and opportunities to enhance their credibility.

Documentation:

https://doi.org/10.1145/3380994

References:
  1. Torbjorn Akerstedt, Ken Hume, David Minors, and Jim Waterhouse. 1994. The meaning of good sleep: a longitudinal study of polysomnography and subjective sleep quality. J Sleep Res 3, 3 (1994), 152–158. https://doi.org/10.1111/j.1365-2869.1994.tb00122.x
  2. Florin Amzica and Mircea Steriade. 2002. The functional significance of K-complexes. Sleep Medicine Reviews 6, 2 (2002), 139–149. https://doi.org/10.1053/smrv.2001.0181
  3. Nayyab Asif, Razia Iqbal, and Chaudhry Fahad Nazir. 2017. Human immune system during sleep. American Journal of Clinical and Experimental Immunology 6, 6 (2017), 92–96.
  4. Lauren Babcock, Kelsey Riggs, Vernon Rowe, John Hunter, Arlene O’Shea, Doug Schell, Dorsey Paul, Mark Varona, Shelia Miller, James Barnett, and Snehal Kadia. 2018. Polysomnography is crucial to the diagnosis of sleep disordered breathing syndromes in patients with hypermobility spectrum disorder (P1.099). Neurology 90, 15 Supplement (2018).
  5. Jared S. Bauer, Sunny Consolvo, Ben Greenstein, Jonathan W Schooler, Eric Wu, Nathaniel F Watson, and Julie A. Kientz. 2012. ShutEye: encouraging awareness of healthy sleep recommendations with a mobile, peripheral display. In Proceedings of the 2012 SIGCHI Conference on Human Factors in Computing Systems. ACM Press, New York, NY, 1401–1410. https://doi.org/10.1145/2207676.2208600
  6. Gretchen K. Berland, Marc N. Elliott, Leo S. Morales, Jeffrey I. Algazy, Richard L. Kravitz, Michael S. Broder, David E. Kanouse, Jorge A. Muñoz, Juan-Antonio Puyol, Marielena Lara, Katherine E. Watkins, Hannah Yang, and Elizabeth A. McGlynn. 2001. Health information on the Internet: accessibility, quality, and readability in English and Spanish. JAMA 285, 20 (2001), 2612–2621. https://doi.org/10.1016/j.physbeh.2016.03.006
  7. J. Bornemark. 2018. The limits of ratio: an analysis of NPM in Sweden using Nicholas of Cusa’s understanding of reason. In Metric Culture: Ontologies of Self-tracking Practices, B. Ajana (Ed.). Emerald Publishing Limited, UK, 235–253.
  8. M. Boselli, L. Parrino, A. Smerieri, and M. Terzano. 1998. Effect of age on EEG arousals in normal sleep. Sleep 21, 4 (1998), 351–357.
  9. Virginia Braun and Victoria Clarke. 2015. Using thematic analysis in psychology. Qual Res Psychol 3, 2 (2015), 77–101. https://doi.org/10.1191/1478088706qp063oa
  10. Daniel J. Buysse. 2014. Sleep Health: Can We Define It? Does It Matter? Sleep 37, 1 (2014), 9–17. https://doi.org/10.5665/sleep.3298
  11. Daniel J. Buysse, Charles F. Reynolds, Timothy H. Monk, Susan R. Berman, and David J. Kupfer. 1989. The Pittsburgh sleep quality index: a new instrument for psychiatric practice and research. Psychiatry Res 28, 2 (1989), 193–213. https://doi.org/10.1016/0165-1781(89)90047-4
  12. Walter Weiss Carl I. Hovland. 1951. The influence of source credibility on communication effectiveness. Public Opinions Quarterly 15, 4 (1951), 635–650. https://doi.org/10.1086/266350
  13. Colleen E. Carney, Daniel J. Buysse, Sonia Ancoli-Israel, Jack D. Edinger, Andrew D. Krystal, Kenneth L. Lichstein, and Charles M. Morin. 2012. The consensus sleep diary: standardizing prospective sleep self-monitoring. Sleep 35, 2 (2012), 287–302. https://doi.org/10.5665/sleep.1642
  14. Eun Kyoung Choe, Sunny Consolvo, Nathaniel F Watson, and Julie A. Kientz. 2011. Opportunities for computing technologies to support healthy sleep behaviors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press, New York, NY, 3053–3062. https://doi.org/10.1145/1978942.1979395
  15. Eun Kyoung Choe, Bongshin Lee, Wanda Marie Pratt Matthew Kay, and Julie A. Kientz. 2015. SleepTight: low-burden, self-monitoring technology for capturing and reflecting on sleep behaviors. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM Press, New York, NY, 121–132. https://doi.org/10.1145/2750858.2804266
  16. Nediyana Daskalova, Bongshin Lee, Jeff Huang, Jessica Lundin, and Chester Ni. 2018. Investigating the effectiveness of cohort-based sleep recommendations. Proc ACM Interact Mob Wearable Ubiquitous Technol 2, 3 (2018), Article 101. https://doi.org/10.1145/3264911
  17. Nediyana Daskalova, Danae Metaxa-Kakavouli, Adrienne Tran, Nicole Nugent, Julie Boergers, John McGeary, and Jeff Huang. 2016. SleepCoacher: A Personalized Automated Self-Experimentation System for Sleep Recommendations. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM Press, New York, NY, 347–358. https://doi.org/10.1145/2984511.2984534
  18. Massimiliano de Zambotti, Fiona C. Baker, and Ian M. Colrain. 2015. Validation of sleep-tracking technology compared with polysomnography in adolescents. Sleep 38, 9 (2015), 1461–1468. https://doi.org/10.5665/sleep.4990
  19. Massimiliano de Zambotti, Fiona C. Baker, Adrian R. Willoughby, Job G. Godino, David Wing, Kevin Patrick, and Ian M. Colrain. 2016. Measures of sleep and cardiac functioning during sleep using a multi-sensory commercially-available wristband in adolescents. Physiological Behavior 158 (2016), 143–149. https://doi.org/10.1016/j.physbeh.2016.03.006
  20. Massimiliano de Zambotti, Stephanie Claudatos, Sarah Inkelis, Ian M. Colrain, and Fiona C. Baker. 2015. Evaluation of a consumer fitness-tracking device to assess sleep in adults. Chronobiology International 32, 7 (2015), 1024–1028. https://doi.org/10.3109/07420528.2015.1054395
  21. Massimiliano de Zambotti, Aimee Goldstone, Stephanie Claudatos, Ian M. Colrain, and Fiona C. Baker. 2018. A validation study of Fitbit Charge 2 compared with polysomnography in adults. Chronobiology International 35, 4 (2018), 465–476. https://doi.org/10.1080/07420528.2017.1413578
  22. Alan B. Douglass, Robert F. Bornstein, German Nino-Murcia, Sharon Keenan, and et al. 1994. The Sleep Disorders Questionnaire: I. creation and multivariate structure of SDQ. Sleep 17, 2 (1994), 160–167. https://doi.org/10.1093/sleep/17.2.160
  23. Mohan Dutta-Bergman. 2003. Trusted online sources of health information: differences in demographics, health beliefs and health-information orientation. J Med Internet Res 5 (2003), e21. https://doi.org/10.2196/jmir.5.3.e21
  24. Mohan J. Dutta-Bergman. 2006. The impact of completeness and web use motivation on the credibility of e-health information. Journal of Communication 54, 2 (2006), 253–269. https://doi.org/10.1111/j.1460-2466.2004.tb02627.x
  25. Gunther Eysenbach. 2008. Credibility of health information and digital media: new perspectives and implications for youth. Digital Media, Youth, and Credibility. Number 123–154. The MIT Press, Cambridge, MA. https://doi.org/10.1162/dmal.9780262562324.123
  26. Zhuo Fang, Valya Sergeeva, Laura B. Ray, and Jeremy Viczko. 2017. Sleep spindles and intellectual ability: epiphenomenon or directly related? Journal of Cognitive Neuroscience 29, 1 (2017), 167–182. https://doi.org/10.1162/jocn_a_01034
  27. B. J. Fogg and Hsiang Tseng. 1999. The elements of computer credibility. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM Press, New York, NY, 80–87. https://doi.org/10.1145/302979.303001
  28. Krisandra S. Freeman and Jan H. Spyridakis. 2004. An examination of factors that affect the credibility of online health information. Technical Communication 51, 2 (2004), 239–263.
  29. Cecilie Gaziano. 1988. How credible is the credibility crisis? Journalism Mass Communication Quarterly 65, 2 (1988), 267–278. https://doi.org/10.1177/107769908806500202
  30. L. D. Gennaro and M. Ferrara. 2003. Sleep spindles: an overview. Sleep Medicine Review 7, 5 (2003), 423–440. https://doi.org/10.1053/smrv.2002.0252
  31. S. Groch, I. Wilhelm, S. Diekelmann, and J. Born. 2013. The role of REM sleep in the processing of emotional memories: Evidence from behavior and event-related potentials. Neurobiology of Learning and Memory 99 (2013), 1–9. https://doi.org/10.1016/j.nlm.2012.10.006
  32. Albert C. Gunther. 1992. Biased press or biased public? Attitudes towards media coverage of social groups. The Public Opinion Quarterly 56, 2 (1992), 147–167.
  33. Péter Halász, Mario Terzano, Liborio Parrino, and Róbert Bódizs. 2004. The nature of arousal in sleep. J Sleep Res 13, 1 (2004), 1–23. https://doi.org/10.1111/j.1365-2869.2004.00388.x
  34. Stephen G. Harkins and Richard E. Petty. 1981. Effects of source magnification of cognitive effort on attitudes: an information-processing view. Journal of Personality of Social Psychology 40 (1981), 401–413. https://doi.org/10.1037/0022-3514.40.3.401
  35. Allison G. Harvey, Kathleen Stinson, Katriina Whitaker, Damian Moskovitz, and Harvinder Virk. 2008. The subjective meaning of sleep quality: a comparison of individuals with and without insomnia. Sleep 31, 3 (2008), 383–393.
  36. Allison G. Harvey and Nicole Tang. 2012. (Mis)Perception of sleep in insomnia: a puzzle and a resolution. Psycho Bull 138, 1 (2012), 77–101. https://doi.org/10.1037/a0025730
  37. Nora Hennies, Matthew A. Lambon Ralph, Marleen Kempkes, James N. Cousins, and Penelope A. Lewis. 2016. Sleep spindle density predicts the effect of prior knowledge on memory consolidation. Journal of Neuroscience 36, 13 (2016), 3799–3810. https://doi.org/10.1523/JNEUROSCI.3162-15.2016
  38. Vanessa Herbert, Daniel Pratt, Richard Emsley, and Simon D. Kyle. 2017. Predictors of nightly subjective-objective sleep discrepancy in poor sleepers over a seven-day period. Brain Sciences 7, 3 (2017), Article 29. https://doi.org/10.3390/brainsci7030029
  39. James A. Horne. 2015. Human REM sleep: influence on feeding behavior, with clinical implications. Sleep Medicine 16, 8 (2015), 910–916. https://doi.org/10.1016/j.sleep.2015.04.002
  40. Fan-Chi Hsiao, Pei-Jung Tsai, Changwei W Wu, Chien-Ming Yang, Timothy Joseph Lane, Hsin-Chien Lee, Ling-Chun Chen, We-Kang Lee, Lu-Hsin Lu, and Yu-Zu Wu. 2018. The neurophysiological basis of the discrepancy between objective and subjective sleep during the sleep onset period: an EEG-fMRI study. Sleep 41, 6 (2018), zsy056. https://doi.org/10.1093/sleep/zsy056
  41. C Iber, Sonia Ancoli-Israel, A. L. Chesson, and Stuart F. Quan. 2017. For the American Academy of Sleep Medicine. The AASM manual for the scoring of sleep and associated events: rules, terminology and technical specifications. Darien, IL: American Academy of Sleep Medicine Version 2.4 (2017).
  42. Vanessa Ibáñez, Josep Silva, and Omar Cauli. 2018. A survey on sleep assessment methods. PeerJ 6 (2018), e4849. https://doi.org/10.7717/peerj.4849
  43. Andreas A. Ioannides, Lichan Liu, Vahe Poghosyan, and George K. Kostopoulos. 2017. Using MEG to understand the progression of light sleep and the emergence and functional roles of spindles and K-complexes. Frontiers in Human Neuroscience 11 (2017), Article 313. https://doi.org/10.3389/fnhum.2017.00313
  44. Marta Jackowska, Samantha Dockray, Hilde Hendrickx, and Andrew Steptoe. 2011. Psychosocial factors and sleep efficiency: discrepancies between subjective and objective evaluations of sleep. Psychosomatic Medicine 73, 9 (2011), 810–816. https://doi.org/10.1097/PSY.0b013e3182359e77
  45. Ing-Marie Jonsson, Helen Harris, and Clifford Nass. 2008. How accurate must an in-car information system be? Consequences of accurate and inaccurate information in cars. In Proceedings of CHI 2008. ACM Press, New York, NY, 1665–1674. https://doi.org/10.1145/1357054.1357315
  46. Seung-Gul Kang, Jae Myeong Kang, Kwang-Pil Ko, Seon-Cheol Park, Sara Mariani, and JiaWeng. 2017. Validity of a commercial wearable sleep tracker in adult insomnia disorder patients and good sleepers. Journal of Psychosomatic Research 97 (2017), 38–44. https://doi.org/10.1016/j.jpsychores.2017.03.009
  47. Matthew Kay, Eun Kyoung Choe, Jesse Shepherd, Benjamin Greenstein, Nathaniel Watson, Sunny Consolvo, and Julie A. Kientz. 2012. Lullaby: a capture access system for understanding the sleep environment. In Proceedings of the ACM Conference on Ubiquitous Computing. ACM Press, New York, NY, 226–234. https://doi.org/10.1145/2370216.2370253
  48. Bhanu Prakash Kolla, Subir Mansukhani, and Meghna P. Mansukhani. 2016. Consumer sleep tracking devices: a review of mechanisms, validity and utility. Expert Review of Medical Devices 13, 5 (2016), 497–506. https://doi.org/10.1586/17434440.2016.1171708
  49. Andrew D. Krystal and Jack D. Edinger. 2018. Measuring sleep quality. Sleep Medicine 9, Supplement 1 (2018), S10-S17. https://doi.org/10.1016/S1389-9457(08)70011-X
  50. Tarcan Kumkale, Dolores Albarracin, and Paul J. Seignourel. 2010. The effects of source credibility in the presence or absence of prior attitudes: implications for the design of persuasive communication campaigns. J Appl Soc Psychol 40, 6 (2010), 1325–1356. https://doi.org/10.1111/j.1559-1816.2010.00620.x
  51. Amanda Lazar, Christian Koehler, Theresa Jean Tanenbaum, and David H Nguyen. 2015. Why we use and abandon smart devices. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp’15). ACM Press, New York, NY, 635–646. https://doi.org/10.1145/2750858.2804288
  52. Julia Lechinger, Dominik Philip Johannes Heib, Walter Gruber, Manuel Schabus, and Wolfgang Klimesch. 2015. Heartbeat-related EEG amplitude and phase modulations from wakefulness to deep sleep: interactions with sleep spindles and slow oscillations. Psychophysiology 52, 11 (2015), 1441–1450. https://doi.org/10.1111/psyp.12508
  53. Sakari Lemola, Thomas Ledermann, and Elliot M. Friedman. 2013. Variability of sleep duration is related to subjective sleep quality and subjective well-being: an actigraphy study. PLoS ONE 8, 8 (2013), e71292. https://doi.org/10.1371/journal.pone.0071292
  54. Zilu Liang and Mario Alberto Chapa-Martell. 2018. Not all errors are created equal: influence of user characteristics on measuring errors of consumer wearable devices for sleep tracking. EAI Endorsed Transactions on Pervasive Health and Technology 18, 15 (2018), e4. https://doi.org/10.4108/eai.24-7-2018.159404
  55. Zilu Liang and Mario Alberto Chapa-Martell. 2018. Validity of consumer activity wristbands and wearable EEG for measuring overall sleep parameters and sleep structure in free-living conditions. Journal of Healthcare Informatics Research 2, 1–2 (2018), 152–178. https://doi.org/10.1007/s41666-018-0013-1
  56. Zilu Liang and Mario Alberto Chapa-Martell. 2019. Accuracy of Fitbit wristbands in measuring sleep stage transitions and the effect of user-specific factors. JMIR Mhealth Uhealth 7, 6 (2019), e13384. https://doi.org/10.2196/13384
  57. Zilu Liang and Mario Alberto Chapa-Martell. 2019. Combining numerical and visual approaches in validating sleep data quality of consumer wearable wristbands. In Proceedings of the 17th Annual IEEE International Conference on Pervasive Computing and Communications. 777–782. https://doi.org/10.1109/PERCOMW.2019.8730805
  58. Zilu Liang and Bernd Ploderer. 2016. Sleep tracking in the real world: a qualitative study into barriers for improving sleep. In Proceedings of the 28th Australian Conference on Computer-Human Interaction. ACM Press, New York, NY, 537–541. https://doi.org/10.1145/3010915.3010988
  59. Zilu Liang, Bernd Ploderer, and Mario Alberto Chapa-Martell. 2017. Is fitbit fit for sleep-tracking?: sources of measurement errors and proposed countermeasures. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare. ACM Press, New York, NY, 476–479. https://doi.org/10.1145/3154862.3154897
  60. Zilu Liang, Bernd Ploderer, Wanyu Liu, Yukiko Nagata, James Bailey, Lars Kulik, and Yuxuan Li. 2016. SleepExplorer: a visualization tool to make sense of correlations between personal sleep data and contextual factors. Personal Ubiquitous Comput 20, 6 (2016), 985–1000. https://doi.org/10.1007/s00779-016-0960-6
  61. Wanyu A. Liu, Bernd Ploderer, and Thuong Hoang. 2015. In bed with technology: challenges and opportunities for sleep tracking. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction. ACM Press, New York, NY, 142–151. https://doi.org/10.1145/2838739.2838742
  62. Hannah G. Lund, Bruce D. Rybarczyk, Paul B. Perrin, David Leszczyszyn, and Edward Stepanski. 2013. The discrepancy between subjective and objective measures of sleep in older adults receiving CBT for comorbid insomnia. Journal of Clinical Psychology 69, 10 (2013), 1108–1120. https://doi.org/10.1002/jclp.21938
  63. Janna Mantua, Nickolas Gravel, and Rebecca M. C. Spencer. 2016. Reliability of sleep measures from four personal health monitoring devices compared to research-based actigraphy and polysomnography. Sensors 16, 5 (2016), 646. https://doi.org/10.3390/s16050646
  64. Miguel Marino, Yi Li, Michael N. Rueschman, J. W. Winkelman, J. M. Ellenbogen, J. M. Solet, Hilary Dulin, Lisa F. Berkman, and Orfeu M. Buxton. 2013. Measuring sleep accuracy, sensitivity, and specificity of wrist actigraphy compared to polysomnography. Sleep 36, 11 (2013), 1747–1755. https://doi.org/10.5665/sleep.3142
  65. Gerald A. Marks, James P. Shaffery, Arie Oksenberg, Samuel G. Speciale, and Howard P.Roffwarg. 1995. A functional role for REM sleep in brain maturation. Behavioural Brain Research 69, 1–2 (1995), 1–11. https://doi.org/10.1016/0166-4328(95)00018-O
  66. Jennifer L. Martin and Alex D. Hakim. 2011. Wrist actigraphy. CHEST 139, 6 (2011), 1514–1527. https://doi.org/10.1378/chest.10-1872
  67. Antonio Martinez-Nicolas, Marc Guaita, Joan Santamaría, Josep M. Montserrat, María Ángeles Rol, and Juan Antonio Madrid. 2017. Circadian impairment of distal skin temperature rhythm in patients with sleep-disordered breathing. Sleep 40, 6 (2017), zsx067. https://doi.org/10.1093/sleep/zsx067
  68. Catherine McCall and Vaughn McCall. 2012. Objective vs subjective measurements of sleep in depressed insomniacs: first night effect or reverse first night effect? J Clin Sleep Med 8, 1 (2012), 59–65. https://doi.org/10.5664/jcsm.1664
  69. Harrison McKnight and Charles Kacmar. 2007. Factors and effects of information credibility. In Proceedings of the ninth international conference on electronic commerce. 423–432. https://doi.org/10.1145/1282100.1282180
  70. Lisa J. Meltzer, Laura S. Hiruma, Kristin Avis, Hawley Montgomery-Downs, and Judith Valentin. 2015. Comparison of a commercial accelerometer with polysomnography and actigraphy in children and adolescents. Sleep 38, 8 (2015), 1323–1330. https://doi.org/10.5665/sleep.4918
  71. Els I. S. Most, Samir Aboudan, Philip Scheltens, and Eus J.W. Van Someren. 2012. Discrepancy between subjective and objective sleep disturbances in early- and moderate-stage Alzheimer disease. Am J Geriatric Psychiatry 20, 6 (2012), 460–467. https://doi.org/10.1097/JGP.0b013e318252e3ff
  72. Bonnie M. Muir. 1987. Trust between humans and machines, and design of decision aids. International Journal of Man-Machine Studies 27, 5–6 (1987), 527–539. https://doi.org/10.1016/S0020-7373(87)80013-5
  73. V. Natale, D. Leger, M. Martoni, V. Bayon, and A. Erbacci. 2014. The role of actigraphy in the assessment of primary insomnia: a retrospective study. Sleep Medicine 15, 1(2014), 111–115. https://doi.org/10.1016/j.sleep.2013.08.792
  74. M. Ohayon, E. M. Wickwire, M. Hirshkowitz, and et al. 2017. National Sleep Foundation’s sleep quality recommendations: first report. Sleep Health 3, 1 (2017), 6–19. https://doi.org/10.1016/j.sleh.2016.11.006
  75. J.T. Quigley. 2014. This sleep-tracking medical device is so good it’s being tested by Japan’s astronauts. Retrieved February 6, 2020 from https://www.techinasia.com/sleepwell-sleep-scope-japan-medtech-startup-eeg-alternative
  76. Leontien M. Van Ravesteyn, Joke H.M. Tulen, Astrid M. Kamperman, Monique E. Raats, A.J. (Tom) Schneider, Erwin Birnie, Eric A.P. Steegers, Witte J.G. Hoogendijk, Henning W. Tiemeier, and Mijke P. Lambregtse-van den Berg. 2014. Perceived sleep quality is worse than objective parameters of sleep in pregnant women with a mental disorder. J Clin Sleep Med 10, 10 (2014), 1137–1141. https://doi.org/10.5664/jcsm.4118
  77. Ruth Ravichandran, Sang-Wha Sien, Shwetak N. Patel, Julie A. Kientz, and Laura R. Pina. 2017. Making sense of sleep sensors: how sleep sensing technologies support and undermine sleep health. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI’17). ACM Press, New York, NY, 6864–6875. https://doi.org/10.1145/3025453.3025557
  78. CR Consumer Reports. 2020. Fitbit Charge 2 fitness tracker. Retrieved February 6, 2020 from https://www.consumerreports.org/products/fitness-tracker/fitbit-charge-2-387694/overview/
  79. David Robins and Jason Holmes. 2008. Aesthetics and credibility in web site design. Information Processing Management 44, 1 (2008), 386–399. https://doi.org/10.1016/j.ipm.2007.02.003
  80. David Robins, Jason Holmes, and Mary StansburyMary Stansbury. 2010. Consumer health information on the web: the relationship of visual design and perceptions of credibility. Journal of the American Society for Information Science and Technology 61, 1 (2010), 13–29. https://doi.org/10.1002/asi.21224
  81. Richard S. Rosenberg and Steven Van Hout. 2013. The American Academy of Sleep Medicine inter-scorer reliability program: sleep stage scoring. J Clin Sleep Med 9, 1 (2013), 81–87. https://doi.org/10.5664/jcsm.2350
  82. Anita Valanju Shelgikar, Patricia F Anderson, and Marc Stephens. 2016. Sleep tracking, wearable technology, and opportunities for research and clinical care. CHEST 150, 3 (2016), 732–743. https://doi.org/10.1016/j.chest.2016.04.016
  83. Sleeptrackers.io. 2020. Neuroon: Intelligent sleep mask and light therapy device. Retrieved February 6, 2020 from https://sleeptrackers.io/neuroon-mask
  84. Sara Taylor, Akane Sano, Craig Ferguson, Akshay Mohan, and Rosalind W. Picard. 2018. QuantifyMe: An open-source automated single-case experimental design platform. Sensor 18, 4 (2018), 1097. https://doi.org/10.3390/s18041097
  85. Marton Toth, Istvan Kondakor, and Bela Faludi. 2016. Differences of brain electrical activity between moderate and severe obtrusive sleep apneic patients: a LORETA study. Journal of Sleep Research 25, 5(2016), 596–604. https://doi.org/10.1111/jsr.12403
  86. Shawn Tseng and B.J. Fogg. 1999. Credibility and computing technology. Commun. ACM 42, 5 (1999), 39–44. https://doi.org/10.1145/301353.301402
  87. Kounosuke Tsuchiyama, Haruo Nagayama, Kiyomi Kudo, Katsuhiro Kojima, and Kumiko Yamada. 2003. Discrepancy between subjective and objective sleep in patients with depression. Psychiatry and Clinical Neurosciences 57, 3 (2003), 259–264. https://doi.org/10.1046/j.1440-1819.2003.01114.x
  88. Peter P. Ujma, Piroska Sandor, Sara Szakadat, Ferenc Gombos, and Robert Bodizs. 2016. Sleep spindles and intelligence in early childhood-developmental and trait-dependent aspects. Developmental Psychology 52, 12 (2016), 2118–2129. https://doi.org/10.1037/dev0000233
  89. Geert J. M. van Boxtel, Pierre J. M. Cluitmans, Roy J. E. M. Raymann, and Martin Ouwerkerk. 2018. Heart rate variability, sleep, and the early detection of post-traumatic stress disorder. Sleep and Combat-Relate Post Traumatic Stress Disorder (2018), 253–263. https://doi.org/10.1007/978-1-4939-7148-0_22
  90. Anna Westerlund, Ylva Trolle Lagerros, Goran Kecklund, and John Axelsson. 2016. Relationships between questionnaire ratings of sleep quality and polysomnography in healthy adults. Behavioral Sleep Medicine 14, 2 (2016), 185–199. https://doi.org/10.1080/15402002.2014.974181
  91. Ryen W. White and Eric Horvitz. 2015. Belief dynamics and biases in web search. ACM Transactions on Information Systems 33, 4 (2015), Article 18. https://doi.org/10.1145/2746229
  92. Kristine A. Wilckens, Fabio Ferrarelli, Matthew P. Walker, and Daniel J. Buysse. 2018. Slow-wave activity enhancement to improve cognition. Trends in Neurosciences 41, 7 (2018), 470–482. https://doi.org//10.1016/j.tins.2018.03.003
  93. Huahai Yang, Yunyao Li, and Michelle Zhou. 2014. Understand users’ comprehension and preferences for composing information visualizations. ACM Transactions on Computer-Human Interaction (TOCHI) 21, 1 (2014), Article 6. https://doi.org/10.1145/2541288
  94. Rayoung Yang, Eunice Shin, Mark Webster Newman, and Mark Steven Ackerman. 2015. When fitness trackers don’t ‘fit’: end-user difficulties in the assessment of personal tracking device accuracy. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM Press, New York, NY, 623–634. https://doi.org/10.1145/2750858.2804269