On the Receptivity of Employees to Just-In-Time Self-Tracking and ECoaching for Stress Management: A Mixed Methods Approach

by | Feb 2, 2021 | Research Publications

Author(s):

  • Aniek Lentferink,
  • Matthijs L. Noordzij,
  • Anouk Burgler,
  • Randy Klaassen,
  • Youri Derks,
  • Hilbrand Oldenhuis

Abstract:

Smartphones are powerful tools for reaching the user when it is most needed, i.e. Just-In-Time (JIT). In the context of stress management in professionals, self-tracking can create awareness about stress and eCoaching can provide personalised JIT coping suggestions. Employees should also be receptive to take in or act upon the JIT-messages. Therefore, this study aims to explore what factors (emotional state, events or conditions, and content of the message) affect the employees’ receptivity to JIT-messages. 17 participants were invited to use a prototype of the Resilience Navigator app for two weeks. The mixed-methods approach consisted of mixed effects models analysis on data collected via the app (receptivity and the factors of interest) and qualitative analysis on semi-structured interview data collected after the study period. The overall finding was that the participants’ receptivity in the context of stress management often mismatches with the most relevant moments for JIT-messages. For example, emotions with a negative valence seemed to influence the receptivity towards JIT-messages negatively, although the perceived relevance was high. As technology can pinpoint the most receptive and relevant moment for sending JIT-messages, we advocate to further study this topic with more robust quantitative data.

Documentation:

https://doi.org/10.1080/0144929X.2021.1876764

References:
  • Ahtinen, A., E. Mattila, P. Välkkynen, K. Kaipainen, T. Vanhala, M. Ermes, E. Sairanen, T. Myllymäki, and R. Lappalainen. 2013. “Mobile Mental Wellness Training for Stress Management: Feasibility and Design Implications Based on a One-Month Field Study.” Jmir Mhealth and Uhealth 1 (2): e11. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Bagby, R. M., J. D. Parker, and G. J. Taylor. 1994. “The Twenty-Item Toronto Alexithymia Scale—I. Item Selection and Cross-Validation of the Factor Structure.” Journal of Psychosomatic Research 38 (1): 23–32. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • BMS lab [Internet]. 2020. TIIM (The Incredible Intervention Machine). Accessed January 3, 2020. https://bmslab.utwente.nl/knowledgebase/tiim/. [Google Scholar]
  • Brouwer, A. M., E. van Dam, J. van Erp, D. P. Spangler, and J. R. Brooks. 2018. “Improving Real-Life Estimates of Emotion Based on Heart Rate: A Perspective on Taking Metabolic Heart Rate into Account.” Frontiers in Human Neuroscience 12: 1–10. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Burke, L. E., S. Shiffman, E. Music, M. A. Styn, A. Kriska, A. Smailagic, D. Siewiorek, et al. 2017. “Ecological Momentary Assessment in Behavioral Research: Addressing Technological and Human Participant Challenges.” Journal of Medical Internet Research 19 (3): e77. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Burns, C. 2018. “Human-Centred Design.” In eHealth Research, Theory and Development, edited by L. Van Gemert-Pijnen, S. Kelders, H. Kip, and R. Sanderman, 207–227. Oxon and New York: Routledge. [Crossref], [Google Scholar]
  • Butler, A. C., J. E. Chapman, E. M. Forman, and A. T. Beck. 2006. “The Empirical Status of Cognitive-Behavioral Therapy: A Review of Meta-Analyses.” Clinical Psychology Review 26 (1): 17–31. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Cohen, S., T. Kamarck, and R. Mermelstein. 1983. “A Global Measure of Perceived Stress.” Journal of Health and Social Behavior 24 (4): 385–396. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Covey, S. 1989. Seven Habits of Highly Effective People. 1st ed. New York: Simon and Schuster. [Google Scholar]
  • Crane, M., B. J. Searle, M. Kangas, and Y. Nwiran. 2019. “How Resilience is Strengthened by Exposure to Stressors: The Systematic Self-Reflection Model of Resilience Strengthening.” Anxiety, Stress, and Coping 32 (1): 1–17. [Taylor & Francis Online], [Web of Science ®], [Google Scholar]
  • Creswell, J. W., and V. L. P. Clark. 2017. Designing and Conducting Mixed Methods Research. 3rd ed. Newbury Park, CA: Sage publications. [Google Scholar]
  • Cuijpers, P., L. Shields-Zeeman, B. Hipple Walters, and I. Petrea. 2016. “Prevention of Depression and Promotion of Resilience – Consensus Paper.” The European Commission. Accessed January 17, 2018. Available from: https://www.nap.edu/catalog/10149/improving-palliative-care-for-cancer.https://ec.europa.eu/health/sites/health/files/mental_health/docs/ev_20161006_co03_en.pdf. [Crossref], [Google Scholar]
  • Derks, Y. P., T. de Visser, E. T. Bohlmeijer, and M. L. Noordzij. 2017. “mHealth in Mental Health: How to Efficiently and Scientifically Create an Ambulatory Biofeedback e-Coaching app for Patients with Borderline Personality Disorder.” International Journal of Human Factors and Ergonomic 5 (1): 61–92. [Crossref], [Google Scholar]
  • Derks, Y. P., R. Klaassen, G. J. Westerhof, E. T. Bohlmeijer, and M. L. Noordzij. 2019. “Development of an Ambulatory Biofeedback App to Enhance Emotional Awareness in Patients with Borderline Personality Disorder: Multicycle Usability Testing Study.” Jmir Mhealth and Uhealth 7 (10). [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • De Witte, N. A. J., I. Buyck, and T. Van Daele. 2019. “Combining Biofeedback with Stress Management Interventions: A Systematic Review of Physiological and Psychological Effects.” Applied Psychophysiology and Biofeedback 44 (2): 71–82. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Eurofound and EU-OSHA. 2014. Psychosocial Risks in Europe: Prevalence and Strategies for Prevention. Luxembourg: Publications Office of the European Union. [Google Scholar]
  • European Commission [Internet]. 2019. Technology Readiness Levels. Accessed October 7, 2019. https://ec.europa.eu/research/participants/data/ref/h2020/wp/2014_2015/annexes/h2020-wp1415-annex-g-trl_en.pdf. [Google Scholar]
  • Evers, C., H. Hopp, J. J. Gross, A. H. Fischer, A. S. R. Manstead, and I. B. Mauss. 2014. “Emotion Response Coherence: A Dual-Process Perspective.” Biological Psychology 98: 43–49. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Eysenbach, G., and Consort-EHEALTH Group. 2011. “CONSORT-EHEALTH: Improving and Standardizing Evaluation Reports of Web-Based and Mobile Health Interventions.” Journal of Medical Internet Research 13 (4). [Crossref], [Web of Science ®], [Google Scholar]
  • Fischer, J. E., N. Yee, V. Bellotti, N. Good, S. Benford, and C. Greenhalgh. 2010. “Effects of Content and Time of Delivery on Receptivity to Mobile Interruptions.” MobileHCI 2010: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services; 2010, September 7–10; Lisbon, Portugal. New York: Association for Computing Machinery. [Google Scholar]
  • Fredrickson, B. L. 2004. “The Broaden–and–Build Theory of Positive Emotions.” Philosophical Transactions of the Royal Society of London B Biological Sciences 359 (1449): 1367–1377. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Fredrickson, B. L. 2013. “Updated Thinking on Positivity Ratios.” The American Psychologist 68 (9): 814–822. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Garrett, J J. 2011. The elements of user experience: user-centered design for the web and beyond. 2nd ed. London: Pearson Education. [Google Scholar]
  • Gross, J. J. 2015. “Emotion Regulation: Current Status and Future Prospects.” Psychological inquiry 26 (1): 1–26. [Taylor & Francis Online], [Web of Science ®], [Google Scholar]
  • Hardeman, W., J. Houghton, K. Lane, A. Jones, and F. Naughton. 2019. “A Systematic Review of Just-in-Time Adaptive Interventions (JITAIs) to Promote Physical Activity.” The international Journal of Behavioral Nutrition and Physical Activity 16 (1): 1–21. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Harmon, E., and M. Mazmanian. 2013. “Stories of the Smartphone in Everyday Discourse: Conflict, Tension & Instability.” In CHI ‘13: CHI Conference on Human Factors in Computing Systems; 2013 Apr 27 to May 2, edited by S. Bødker, S. Brewster, P Baudisch, M Beaudouin-Lafon, and W. E. Mackay, 1051–1060. Paris, France. New York: Association for Computing Machinery. [Crossref], [Google Scholar]
  • Hayes, S. C., J. B. Luoma, F. W. Bond, A. Masuda, and J. Lillis. 2006. “Acceptance and Commitment Therapy: Model, Processes and Outcomes.” Behaviour Research and Therapy 44 (1): 1–25. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Kooiman, T. J., M. L. Dontje, S. R. Sprenger, W. P. Krijnen, C. P. Van der Schans, and M. De Groot. 2015. “Reliability and Validity of ten Consumer Activity Trackers.” Bmc Sports Science, Medicine and Rehabilitation 7 (1): 1–11. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Korten, N. C., H. C. Comijs, B. W. J. H. Penninx, and D. J. H. Deeg. 2017. “Perceived Stress and Cognitive Function in Older Adults: Which Aspect of Perceived Stress is Important?” Int J Geriatr Psychiatr 32 (4): 439–445. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Künzler, F., J. N. Kramer, and T. Kowatsch. 2017. “Efficacy of Mobile Context-Aware Notification Management Systems: A Systematic Literature Review and Meta-Analysis.” IEEE: Proceedings of the 13th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob); 2017 Oct 9–11; Rome, Italy. Piscataway, New Jersey: IEEE. [Google Scholar]
  • LASA [Internet]. 2018. Amsterdam: Longitudinal Aging Study Amsterdam. Perceived Stress [1 screen]. Accessed January 29, 2018. https://www.lasa-vu.nl/themes/emotional/perceived-stress.htm. [Google Scholar]
  • Lazarus, R. S., and S. Folkman. 1987. “Transactional Theory and Research on Emotions and Coping.” European Journal of Personality 1 (3): 141–169. [Crossref], [Google Scholar]
  • Lentferink, A. J., H. K. E. Oldenhuis, M. de Groot, L. Polstra, H. Velthuijsen, and J. E. W. C. Van Gemert-Pijnen. 2017. “Key Components in EHealth Interventions Combining Self-Tracking and Persuasive ECoaching to Promote a Healthier Lifestyle: A Scoping Review.” Journal of Medical Internet Research 19 (8). [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Lentferink, A., L. Polstra, M. de Groot, H. Oldenhuis, H. Velthuijsen, and L. van Gemert-Pijnen. 2018. “The Values of Self-Tracking and Persuasive ECoaching According to Employees and Human Resource Advisors for a Workplace Stress Management Application: A Qualitative Study.” In PERSUASIVE 2018: Proceedings of the 13th International Conference on Persuasive Technology; 2018 Apr 16–19, edited by J. Ham, E. Karapanos, P. Morita, and C. Burns, 160–171. Waterloo, Canada. New York: Springer. [Crossref], [Google Scholar]
  • Lentferink, A., L. Polstra, A. D’Souza, H. Oldenhuis, H. Velthuijsen, and J. Van Gemert-Pijnen. 2020. “Creating Value with EHealth: Identification of the Value Proposition with Key Stakeholders for the Resilience Navigator App.” BMC Medical Informatics and Decision Making 20: 1–15. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Lukoff, K., C. Yu, J. Kientz, and A. Hiniker. 2018. “What Makes Smartphone Use Meaningful or Meaningless?” Proc. ACM Interact. Mob. Wearable Ubiquitous Technol 2 (1): 1–26. [Crossref], [Google Scholar]
  • Mark, G., S. T. Iqbal, M. Czerwinski, and P. Johns. 2016. “Bored Mondays and Focused Afternoons: The Rhythm of Attention and Online Activity in the Workplace.” Proceedings of the 2014 CHI Conference on Human Factors in Computing Systems. 2014 April 26 to May 01; Toronto, Canada. New York: Association for Computing Machinery; 3025–3034. [Crossref], [Google Scholar]
  • Mattila, A. K., K. Ahola, T. Honkonen, J. K. Salminen, H. Huhtala, and M. Joukamaa. 2007. “Alexithymia and Occupational Burnout are Strongly Associated in Working Population.” Journal of Psychosomatic Research 62 (6): 657–665. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Mehrotra, A., V. Pejovic, J. Vermeulen, R. Hendley, and M. Musolesi. 2016. “My Phone and Me: Understanding People’s Receptivity to Mobile Notifications.” Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems; 2016 May 2–7; San Jose, California, USA. New York: Association for Computing Machinery; 1021–1032. [Crossref], [Google Scholar]
  • Michie, S. 2002. “Causes and Management of Stress at Work.” Occupational and Environmental Medicine 59 (1): 67–72. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Morse, J. M. 1991. “Approaches to Qualitative-Quantitative Methodological Triangulation.” Nursing Research 40 (2): 120–123. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Myrtek, M., E. Aschenbrenner, and G. Brügner. 2005. “Emotions in Everyday Life: An Ambulatory Monitoring Study with Female Students.” Biological Psychology 68 (3): 237–255. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Myrtek, M., E. Frölich, A. Fichtler, and G. Brügner. 2000. “ECG Changes, Emotional Arousal, and Subjective State: An Ambulatory Monitoring Study with CHD Patients.” Journal of Psychophysiology 14 (2): 106–114. [Crossref], [Web of Science ®], [Google Scholar]
  • Nahum-Shani, I., E. B. Hekler, and D. Spruijt-Metz. 2015. “Building Health Behavior Models to Guide the Development of Just-in-Time Adaptive Interventions: A Pragmatic Framework.” Health Psychology 34 (S): 1209–1219. [Crossref], [Web of Science ®], [Google Scholar]
  • Nahum-Shani, I., S. N. Smith, B. J. Spring, L. M. Collins, K. Witkiewitz, A. Tewari, and S. A. Murphy. 2018. “Just-in-Time Adaptive Interventions (JITAIs) in Mobile Health: key Components and Design Principles for Ongoing Health Behavior Support.” Annals of Behavioral Medicine 52 (6): 446–462. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Noorbergen, T. J., M. T. P. Adam, J. R. Attia, D. J. Cornforth, and M. Minichiello. 2019. “Exploring the Design of MHealth Systems for Health Behavior Change Using Mobile Biosensors.” Communications of the Association for Information Systems 44 (1): 944–981. [Crossref], [Web of Science ®], [Google Scholar]
  • Ong, A. D., C. S. Bergeman, T. L. Bisconti, and K. A. Wallace. 2006. “Psychological Resilience, Positive Emotions, and Successful Adaptation to Stress in Later Life.” Journal of Personality and Social Psychology 91 (4): 730–749. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Onwuegbuzie, A. J., and K. M. Collins. 2007. “A Typology of Mixed Methods Sampling Designs in Social Science Research.” Qualitative Report (online) 12 (2): 281–316. [Google Scholar]
  • Petty, R. E., and J. T. Cacioppo. 1986. “The Elaboration Likelihood Model of Persuasion.” Advances in Experimental Social Psychology 19: 124–192. [Crossref], [Google Scholar]
  • Portzky, M., G. Wagnild, D. De Bacquer, and K. Audenaert. 2010. “Psychometric Evaluation of the Dutch Resilience Scale RS-nl on 3265 Healthy Participants: A Confirmation of the Association Between age and Resilience Found with the Swedish Version.” Scandinavian Journal of Caring Sciences 24: 86–92. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Posner, J., J. A. Russell, and B. S. Peterson. 2005. “The Circumplex Model of Affect: An Integrative Approach to Affective Neuroscience, Cognitive Development, and Psychopathology.” Development and Psychopathology 17 (3): 715–734. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Sano, A., P. Johns, and M. Czerwinski. 2017. “Designing Opportune Stress Intervention Delivery Timing Using Multi-Modal Data. ACII 2017: Proceedings of the 7th International Conference on Affective Computing and Intelligent Interaction; 2017 October 23–26; San Antonio, Texas, USA. New Jersey: IEEE, 346–353. [Google Scholar]
  • Seligman, M. E., and M. Csikszentmihalyi. 2014. Positive Psychology: An Introduction. In: Flow and the Foundations of Positive Psychology, 279–298. Dordrecht: Springer. [Google Scholar]
  • Sheeran, P., and T. L. Webb. 2016. “The Intention–Behavior Gap.” Social and Personality Psychology Compass 10 (9): 503–518. [Crossref], [Web of Science ®], [Google Scholar]
  • Sieverink, F., N. Köhle, K. Cheung, A. Roefs, H. Trompetter, J. Keizer, et al. 2018. “Evaluating eHealth.” In eHealth Research, Theory and Development, edited by L. Van Gemert-Pijnen, S. Kelders, H. Kip, and R. Sanderman, 290–318. Oxon and New York: Routledge. [Crossref], [Google Scholar]
  • Smith, B. W., J. Dalen, K. Wiggins, E. Tooley, P. Christopher, and J. Bernard. 2008. “The Brief Resilience Scale: Assessing the Ability to Bounce Back.” International Journal of Behavioral Medicine 15 (3): 194–200. [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Smith, B. W., E. M. Epstein, J. A. Ortiz, P. J. Christopher, and E. M. Tooley. 2013. “The Foundations of Resilience: What are the Critical Resources for Bouncing Back from Stress?” In Resilience in Children, Adolescents, and Adults, edited by S. Prince-Embury and D. H. Saklofske, 167–187. New York: Springer-Verlag. [Crossref], [Google Scholar]
  • Stahl, S. E., H. S. An, D. M. Dinkel, J. M. Noble, and J. M. Lee. 2016. “How Accurate are the Wrist-Based Heart Rate Monitors During Walking and Running Activities? Are They Accurate Enough?” BMJ Open Sport Exerc Med 2 (1). [PubMed], [Google Scholar]
  • Stone, N. J., A. Chaparro, J. R. Keebler, B. S. Chaparro, and D. S. McConnell. 2017. “Attention, Memory, and Multitasking.” In Introduction to Human Factors – Applying Psychology to Design, edited by N. J. Stone, A. Chaparro, J. R. Keebler, B. S. Chaparro, and D. S. McConnell, 175–200. Boca Raton: Crc Press. [Crossref], [Google Scholar]
  • Tavares, J., and T. Oliveira. 2016. “Electronic Health Record Patient Portal Adoption by Health Care Consumers: An Acceptance Model and Survey.” Journal of Medical Internet Research 18 (3). [Crossref], [PubMed], [Web of Science ®], [Google Scholar]
  • Twisk, J. W. 2006. Applied Multilevel Analysis: a Practical Guide for Medical Researchers. 1st ed. Cambridge: Cambridge University Press. [Crossref], [Google Scholar]
  • Van Berkel, N., D. Ferreira, and V. Kostakos. 2018. “The Experience Sampling Method on Mobile Devices.” Acm Computing Surveys 50 (6): 1–40. [Crossref], [Web of Science ®], [Google Scholar]
  • Van Gemert-Pijnen, L., H. Kip, S. M. Kelders, and R. Sanderman. 2018. “Introducting EHealth.” In eHealth Research, Theory and Development, edited by L. Van Gemert-Pijnen, S. Kelders, H. Kip, and R. Sanderman, 3–26. Oxon and New York: Routledge. [Crossref], [Google Scholar]
  • van Gemert-Pijnen, J. E., N. Nijland, M. van Limburg, H. C. Ossebaard, S. M. Kelders, G. Eysenbach, and E. R. Seydel. 2011. “A Holistic Framework to Improve the Uptake and Impact of EHealth Technologies.” Journal of Medical Internet Research 13 (4). [Crossref], [Web of Science ®], [Google Scholar]
  • Vastenburg, M. H., D. V. Keyson, and H. De Ridder. 2004. “Interrupting People at Home.” IEEE: Proceedings of the International Conference on Systems, Man and Cybernetics; 2004 October 10–13; The Hague, The Netherlands. Piscataway, New Jersey: IEEE. [Google Scholar]
  • Verma, R., Y. P. S. Balhara, and C. S. Gupta. 2011. “Gender Differences in Stress Response: Role of Developmental and Biological Determinants.” Industrial Psychiatry Journal 20 (1): 4–10. [PubMed], [Google Scholar]
  • Wu T [Internet]. 2019. The Crisis of Attention Theft—Ads that Steal Your Time for Nothing in Return. Accessed August 21, 2019. https://www.wired.com/2017/04/forcing-ads-captive-audience-attention-theft-crime/. [Google Scholar]