Author:
- Alphonsus Keary
- Paul Walsh
Abstract:
This paper primarily relates to the engineering of affective (emotional) computing (AC) capabilities in machines and also considers how such developments may be used to advance the quantified self (QS) paradigm. Our work will provide a literature and technology review providing some general insights and discussion around AC applications, technologies, tools, platforms and alternative controls/interfaces. Specific focus from a quantified self perspective will also be addressed with applied literature references from the affective sciences research community. Readers new to the field will take away a solid understanding of what AC is, how it is impacting on new software innovations and how it relates to QS. Those with existing expertise will gain new research insights, learn about new research projects and software development platforms and will also learn about applied AC and QS research.
Document:
https://doi.org/10.1109/BIBM.2014.6999285
References:
1. R. Picard, “Affective Computing: From Laughter to IEEE,” IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, vol. 1, no. 1, pp. 11-17, January-June 2010. Show Context View Article Full Text: PDF (158KB) Google Scholar
2. M. Clynes, “Dr. Manfred Clynes,” 2008. [Online]. Available: http://www.microsoundmusic.com/clynes.html. Accessed 05 June 2013]. Show Context
3. E. van den Broek, “Ubiquitous Emotion-Aware Computing,” in Pers Ubiquit Comput, 2013. Show Context Google Scholar
4. R. Picard, Affective Computing, MIT Press Cambridge, MA, USA 1997, 1997. Show Context Google Scholar
5. N. S. Consedine and J. T. Moskowitz, “The role of discrete emotions in health outcomes: A critical review,” Applied and Preventive Psychology, vol. 12, pp. 59-75, 2007. Show Context CrossRef Google Scholar
6. Intel, “Intel Real Sense SDK,” 2014. [Online]. Available: http://www.intel.com/content/www/us/en/architectureand-technology/realsense-overview.html. [Accessed 14 April 2014]. Show Context Google Scholar
7. E. Hudlicka, “Affective Computing for Games Design,” in 4th Intl. North American Conference on Intelligent Games and Simulation, Montreal, 2008. Show Context Google Scholar
8. D. Giakoumis, D. Tzovaras, K. Moustakas and G. Hassapis, “Automatic Recognition of Boredom in Video Games Using Novel Biosignal Moment-Based Features,” IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, vol. 2, no. 3, pp. 119-133, July-September 2011. Show Context View Article Full Text: PDF (1491KB) Google Scholar
9. J. Häkkilä, O. Koskenranta, M. Posti, L. Ventä-Olkkonen and A. Colley, “Clearing the Virtual Window-Connecting Two Locations,” in PerDis ’13, International Symposium on Pervasive Displays, California, 2013. Show Context Access at ACM Google Scholar
10. A. Murphy and S. Redfern, “Utilizing Bimodal Emotion Recognition for Adaptive Artificial Intelligence,” International Journal of Engineering Science and Innovative Technology (IJESIT), vol. 2, no. 4, pp. 167-173, July 2013. Show Context Google Scholar 11. P. Ekman, The Face of Man: Expressions of Universal Emotions in a New Guinea Village, Garland STPM Press., 1980. Show Context Google Scholar
12. B. Schuller, B. Vlasenko, F. Eyben and G. Rigoll, “Acoustic emotion recognition: A benchmark comparison of performances,” in Automatic Speech Recognition & Understanding, 2009, pp. 552-557. Show Context View Article Full Text: PDF (172KB) Google Scholar
13. F. Eyben, M. Wöllmer and B. Schuller, “openSMILE-The Munich Versatile and Fast Open-Source Audio Feature Extractor,” in Proc. ACM Multimedia (MM), Firenze, Italy., 2010. Show Context Access at ACM Google Scholar
14. C. Strapparava and A. Valitutti, “WordNet-Affect: an Affective Extension of WordNet,” in Proc. Intl. Conf. Language Resources and Evaluation, 2004. Show Context Google Scholar
15. G. Chanel, K. Kalogianni and T. Pun, “GamEMO: how physiological signals show your emotions and enhance your game experience,” in ICMI ’12 Proceedings of the 14th ACM international conference on Multimodal interaction, Santa Monica, California, 2012. Show Context Google Scholar
16. J. Sabourin and J. Lester, “Affect and Engagement in Game-Based Learning Environments,” IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, vol. Accepted for publication, pp. 1-14, 2013. Show Context Google Scholar
17. Intel Real Sense, “Real Sense Architecture,” 2014. [Online]. Available: https://software.intel.com/sites/landingpage/perceptual-c omputing/documentation/html/. [Accessed 30 April 2014]. Show Context Google Scholar
18. PR Newswire, “Emotient Announces Series B Financing of 6M,” 2014. [Online]. Available: http://www.prnewswire.com/news-releases/emotientannounces-series-b-financing-of-6m-248743221.html. [Accessed 17 April 2014]. Show Context Google Scholar
19. Microsoft, “Kinect for Windows,” 2014. [Online]. Available: http://www.microsoft.com/enus/ kinectforwindows/discover/features.aspx. [Accessed 17 April 2014]. Show Context Google Scholar
20. PSFK.COM, “Kinect system reads emotions to help autistic children socialize,” 2014. [Online]. Available: http://www.psfk.com/2014/03/kinect-autism-emotiondetection. html#!D1LyT. [Accessed 17 April 2014]. Show Context Google Scholar
21. Google, “Google Glass What is does,” 2014. [Online]. Available: http://www.google.com/glass/start/what-itdoes/. [Accessed 17 April 2014]. Show Context Google Scholar
22. Emotient, “Emotient API,” 2014. [Online]. Available: http://www.emotient.com/products#FACETSDK. [Accessed 12 September 2014]. Show Context Google Scholar
23. iMotions Inc, “iMotions About Us,” 2014. [Online]. Available: http://imotionsglobal.com/about/. [Accessed 17 April 2014]. Show Context Google Scholar
24. Shimmer, “Shimmer Sensing,” 2014. [Online]. Available: http://www.shimmersensing.com/. [Accessed 17 April 2014]. Show Context Google Scholar
25. G. S. Taylor and C. Schmidt, “Empirical Evaluation of the Emotiv EPOC BCI Headset for the Detection of Mental Actions,” in Proceedings of the Human Factors and Ergonomics Society 56th Annual Meeting, 2012. Show Context CrossRef Google Scholar
26. M. Perakakis and A. Potamianos, “An Affective Evaluation Tool Using Brain Signals,” in IUI’13 Companion, Santa Monica, USA, 2013. Show Context Access at ACM Google Scholar
27. O. Sourina and Y. Liu, “A Fractal-based Algorithm of Emotion Recognition from EEG using Arousal-Valence Model,” in BIOSIGNALS, Rome, 2011. Show Context Google Scholar
28. J. R. Stroop, “Studies of Interference in Serial Verbal Reactions,” Journal of Experimental Psychology, vol. 28, pp. 643-662, 1935. Show Context CrossRef Google Scholar
29. A. Hinz, S. Klavžar, U. Milutinovi? and C. Petr, The Tower of Hanoi-Myths and Maths, Springer, 2013. Show Context CrossRef Google Scholar
30. K. Crowley, A. Sliney, I. Pitt and D. Murphy, “Evaluating a Brain-Computer Interface to Categorise Human Emotional Response,” in 10th IEEE International Conference on Advanced Learning Technologies, Sousse, Tunisia, 2010. Show Context View Article Full Text: PDF (372KB) Google Scholar
31. NeuroSky, “NeuroSky MindWave Algorithms,” 2014. [Online]. Available: http://neurosky.com/productsmarkets/ eeg-biosensors/algorithms/. [Accessed 18 April 2014]. Show Context Google Scholar
32. Emotiv, “About Emotiv,” 2014. [Online]. Available: http://www.emotiv.com/about/index.php. [Accessed 18 April 2014]. Show Context Google Scholar
33. R. A. Calvo and D. Peters, “The Irony and Reinterpretation of Our Quantified Self,” in OzCHI’13, November 25-29 2013, Adelaide, Australia, 2013. Show Context Access at ACM Google Scholar
34. K. Gaunt, J. Nacsa and M. Penz, “Baby Lucent: Pitfalls of Applying Quantified Self to Baby Products,” in CHI 2014, April 26-May 1, 2014, Toronto, Ontario, Canada, 2014. Show Context Access at ACM Google Scholar
35. J. Meyer, S. Simske, K. Siek, C. Gurrin and H. J. Hermens, “Beyond Quantified Self: Data For Wellbeing,” in CHI 2014, Apr 26-May 01 2014, Toronto, ON, Canada, 2014. Show Context Access at ACM Google Scholar
36. C. Elsden and D. Kirk, “A Quantified Past: Remembering with Personal Informatics,” in DIS 2014, June 21-25, Vancouver, BC, Canada, 2014. Show Context Access at ACM Google Scholar
37. D. Lakens, “Using a Smartphone to Measure Heart Rate Changes during Relived Happiness and Anger,” IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, vol. 4, no. 2, pp. 238-241, April-June 2013. Show Context View Article Full Text: PDF (86KB) Google Scholar
38. M. Karg, K. Kühnlenz and M. Buss, “Recognition of Affect Based on Gait Patterns,” IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS-PART B: CYBERNETICS, vol. 40, no. 4, pp. 1050-1061, August 2010. Show Context View Article Full Text: PDF (494KB) Google Scholar
39. G. E. Sakr, I. H. Elhajj and H. Abou-Saad Huijer, “Support Vector Machines to Define and Detect Agitation Transition,” IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, vol. 1, no. 2, pp. 98-108, July-December 2010. Show Context View Article Full Text: PDF (441KB) Google Scholar
40. W. Wen, G. Liu, N. Cheng, J. Wei, P. Shangguan and W. Huang, “Emotion Recognition Based on Multi-Variant Correlation of Physiological Signals,” IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, vol. 5, no. 2, pp. 126-140, April-June 2014. Show Context View Article Full Text: PDF (1979KB) Google Scholar
41. S. Koelstra, C. Muhl, M. Soleymani, J. S. Lee, A. Yazdani, T. Ebrahimi, T. Pun, A. Nijholt and I. Y. Patras, “DEAP: A Database for Emotion Analysis Using Physiological Signals,” IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, vol. 3, no. 1, pp. 18-31, January-March 2012. Show Context View Article Full Text: PDF (1524KB) Google Scholar
42. M. Kusserow, O. Amft and G. Troster, “Modeling Arousal Phases in Daily Living Using Wearable Sensors,” IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, vol. 4, no. 1, pp. 93-105, January-March 2013. Show Context View Article Full Text: PDF (1113KB) Google Scholar
43. M. Myrtek, G. Brugner, A. Fichtler, K. Konig, W. Muller, F. Foerster and V. Hoppner, “Detection of Emotionally Induced ECG Changes and Their Behavioural Correlates: A New Method for Ambulatory Monitoring,” European Heart Journal, vol. 9, pp. 55-60, 1988. Show Context CrossRef Google Scholar
44. M. Kusserow, O. Amft and G. Troster, “BodyANT: Miniature Wireless Sensors for Naturalistic Monitoring of Daily Activity,” in Proc. Fourth Int’l Conf. Body Area Networks (BodyNets), 2009. Show Context CrossRef Google Scholar