Author(s):
- Aiden R. Doherty
- Niamh Caprani
- Ciarán ÓConaire
- Vaiva Kalnikaite
- Cathal Gurrin
- Alan F. Smeaton
- Noel E. O’Connor
Abstract:
Lifelogging is the process of automatically recording aspects of one’s life in digital form. This includes visual lifelogging using wearable cameras such as the SenseCam and in recent years many interesting applications for this have emerged and are being actively researched. One of the most interesting of these, and possibly the most far-reaching, is using visual lifelogs as a memory prosthesis but there are also applications in job-specific activity recording, general lifestyle analysis and market analysis.
In this work we describe a technique which allowed us to develop automatic classifiers for visual lifelogs to infer different lifestyle traits or characteristics. Their accuracy was validated on a set of 95 k manually annotated images and through one-on-one interviews with those who gathered the images. These automatic classifiers were then applied to a collection of over 3 million lifelog images collected by 33 individuals sporadically over a period of 3.5 years. From this collection we present a number of anecdotal observations to demonstrate the future potential of lifelogging to capture human behaviour. These anecdotes include: the eating habits of office workers; to the amount of time researchers spend outdoors through the year; to the observation that retired people in our study appear to spend quite a bit of time indoors eating with friends. We believe this work demonstrates the potential of lifelogging techniques to assist behavioural scientists in future.
Documentation:
https://doi.org/10.1016/j.chb.2011.05.002
References:
- M.A. ConwayEpisodic memoryNeuropsychologia(2009)
- L.L. Hardy et al.The reliability of the adolescent sedentary activity questionnaire (ASAQ) Journal of Preventive Medicine(2007)
- Tano, S, Takayama, T., Iwata, M., & Hashiyama, T. (2006). Multimedia informal communication by wearable computer based…
- Tancharoen, D., Yamasaki, T., & Aizawa, K. (2006). Practical life log video indexing based on content and context. In…
- Snoek, C. G. M., Everts, I., Gemert, J. C. V., Geusebroek, J. M., Huurnink, B., Koelma, D.C., et al. (2007). The…
- A.F. Smeaton et al.Evaluation campaigns and TRECVid
- A.J. Sellen et al.Beyond total capture: A constructive critique of lifeloggingCommunications of the ACM(2010)
- A.J. Sellen et al.Do life-logging technologies support memory for the past? An experimental study using sensecam
- P. Salembier et al.Introduction to MPEG-7: Multimedia content description interface(2002)
- S. Reddy et al.and clustering for participatory sensing: Lessons from a dietsense prototype
- Qiu, Z., Gurrin, C., Doherty, A. R., & Smeaton, A. F. (2010). Term weighting approaches for mining significant…
- D.H. Nguyen et al.Encountering sensecam: Personal recording technologies in everyday life
- S. MannWearable computing: A first step toward personal imagingComputer(1997)
- W.-H. Lin et al.Structuring continuous video recordings of everyday life using time-constrained clusteringMultimedia content analysis, management, and retieval SPIE-IST electronic imaging(2006)
- Lindley, S. E., Randall, D., Sharrock, W., Glancy, M., Smyth, N., & Harper, R. (2009). Narrative, memory and practice:…
- M. Law et al.The Canadian occupational performance measure: An outcome measure for occupational therapyCanadian Journal of Occupational Therapy(1990)
- Kumpulainen, S., Järvelin, K., Serola, S., Doherty, A. R., Smeaton, A. F., Byrne, D., et al. (2009). Data collection…
- Kelly, P., & Foster, C. (2010). A new technology for measuring our journeys: Results from a pilot study. In 2010 Annual…