Author(s):
Rawassizadeh, Reza
Dobbins, Chelsea
Nourizadeh, Manouchehr
Ghamchili, Zahra
Pazzani, Michael
Abstract:
Currently, personal assistant systems, run on smartphones and use natural language interfaces. However, these systems rely mostly on the web for finding information. Mobile and wearable devices can collect an enormous amount of contextual personal data such as sleep and physical activities. These information objects and their applications are known as quantified-self, mobile health or personal informatics, and they can be used to provide a deeper insight into our behavior. To our knowledge, existing personal assistant systems do not support all types of quantified-self queries. In response to this, we have undertaken a user study to analyze a set of ‘textual questions/queries’ that users have used to search their quantified-self or mobile health data. Through analyzing these questions, we have constructed a light-weight natural language based query interface – including a text parser algorithm and a user interface – to process the users’ queries that have been used for searching quantified-self information. This query interface has been designed to operate on small devices, i.e. smartwatches, as well as augmenting the personal assistant systems by allowing them to process end users’ natural language queries about their quantified-self data.
Document:
https:doi.org/10.1109/PERCOMW.2017.7917645
References:
1. R. Rawassizadeh, B.A. Price and M. Petre, “Wearables: has the age of smartwatches finally arrived?”, Communications of the ACM, vol. 58, no. 1, pp. 45-47, 2014. Show Context Access at ACM Google Scholar
2. M. Llopis and A. Ferrández, “How to make a natural language interface to query databases accessible to everyone: An example”, Computer Standards & Interfaces, vol. 35, no. 5, pp. 470-481, 2013. Show Context CrossRef Google Scholar
3. R. Guha, V. Gupta, V. Raghunathan and R. Srikant, “User Modeling for a Personal Assistant”, Proceedings of the Eighth ACM International Conference on Web Search and Data Mining WSDM ’15, pp. 275-284, 2015. Show Context Access at ACM Google Scholar
4. I. Li, A.K. Dey and J. Forlizzi, “Understanding my Data Myself: Supporting Self-Reflection with Ubicomp Technologies”, Proceedings of the 13th Int. Conf. on Ubiquitous Computing UbiComp ‘11, pp. 405-414, 2011. Show Context Access at ACM Google Scholar
5. E. K. Choe, N. B. Lee, B. Lee, W. Pratt and J. A. Kientz, “Understanding Quantified-Selfers’ Practices in Collecting and Exploring Personal Data”, Proceedings of the 32nd ACM conference on Human factors in Computing Systems. CHI ’14, pp. 1143-1152, 2014. Show Context Access at ACM Google Scholar
6. J. Oh and U. Lee, “Exploring UX issues in Quantified Self technologies”, International Conference on Mobile Computing and Ubiquitous Networking ICMU ‘15, pp. 53-59, 2015. Show Context Google Scholar
7. R. Rawassizadeh, E. Momeni, C. Dobbins, P. Mirza-Babaei and R. Rahnamoun, “Lesson Learned from Collecting Quantified Self Information via Mobile and Wearable Devices”, Journal of Sensor Actuator Network. 2015, vol. 4, no. 4, pp. 315-335, 2015. Show Context CrossRef Google Scholar
8. A. M. Popescu, O. Etzioni and H. Kautz, “Towards a theory of natural language interfaces to databases”, Proceedings of the 8th International Conference on Intelligent user interfaces. IUI ’03, pp. 149-157, 2003. Show Context Access at ACM Google Scholar
9. E. Kaufmann, A. Bernstein and R. Zumstein, “Querix: A Natural Language Interface to Query Ontologies based on Clarification Dialogs”, 5th Int. Semantic Web Conference ISWC ’06, pp. 980-981, 2006. Show Context Google Scholar
10. E. Kaufmann, A. Bernstein and L. Fischer, “NLP-Reduce: A “naive” but Domain-independent Natural Language Interface for Querying Ontologies”, 4th European Semantic Web Conference ESWC ’07, 2007. Show Context Google Scholar
11. F. Li and H. V. Jagadish, “NaLIR: An Interactive Natural Language Interface for Querying Relational Databases”, Proc. of the 2014 ACM SIGMOD Int. Conf. on Management of data. SIGMOD ’14, pp. 709-712, 2014. Show Context Access at ACM Google Scholar
12. R. Rawassizadeh, M. Tomitsch, M. Nourizadeh, E. Momeni, A. Peery, L. Ulanova, et al., “Energy-Efficient Integration of Continuous Context Sensing and Prediction into Smartwatches”, Sensors, vol. 15, no. 9, pp. 22616-22645, 2015. Show Context CrossRef Google Scholar
13. J. Bargas-Avila and K. Hornbæk, “Foci and blind spots in user experience research”, ACM Interactions, vol. 19, no. 6, pp. 24-27, 2012. Show Context Access at ACM Google Scholar
14. M.J. Rosenberg and C.I. Hovland, “Cognitive affective and behavioral components of attitudes”, Attitude organization and change: An analysis of consistency among attitude components, pp. 1-14, 1960. Show Context Google Scholar
15. J.R. Landis and G.G. Kock, “The measurement of observed agreement for categorical data”, Biometrics, vol. 33, pp. 159-174, 1977. Show Context CrossRef Google Scholar
16. J. Baldridge, The openNLP project, 2005, [online] Available: http://opennlp.apache.org/index.html. Show Context Google Scholar
17. D. Andor, C. Alberti, D. Weiss, A. Severyn, A. Presta, K. Ganchev, et al., Globally Normalized Transition-based Neural Networks, 2016. Show Context CrossRef Google Scholar
18. H. A. Lagar-Cavilla, N. Tolia, E. De Lara, M. Satyanarayanan and D. O’Hallaron, “Interactive resource-intensive applications made easy”, ACM/IFIP/USENIX International Conference on Distributed Systems Platforms and Open Distributed Processing, pp. 43-163, 2007. Show Context Google Scholar
19. J. Nielsen, Ten Usability Heuristics, 1994, [online] Available: http://www.useit.com/papers/heuristic/heuristic_list.html. Show Context Google Scholar
20. R. Rawassizadeh, E. Momeni, C. Dobbins, J. Gharibshah and M. Pazzani, “Scalable Daily Human Behavioral Pattern Mining from Multivariate Temporal Data”, IEEE Transactions on Knowledge and Data Engineering, vol. 28, no. 11, pp. 3098-3112, 2016. Show Context View Article Full Text: PDF (1529KB) Google Scholar