Detecting Changes in User Behavior to Understand Interaction Provenance during Visual Data Analysis

The visual analytics tool with six areas of interest: Detailed Histogram (i), Overview Histogram (ii), Network Graph (iii), Offices (iv), Info (v), Table (vi).


Sensemaking in visual analytics attempts to understand how a tool is being used in order to better hand off data for collab- oration and document the formation of research hypotheses. Conventional approaches take advantage of human experts to identify periods of sensemaking using theoretical models or utilize verbalized/written out rationale provided by the users. However, these approaches can be inefficient and inaccurate since they heavily rely on subjective human reports. In this research, we aim to understand how data-driven techniques can automatically identify changes in user behavior (inflection points) based on user interaction logs collected from eye tracking and mouse interactions. We relay the results of a supervised classification system using Hidden Markov Models to automatically predict changes in a visual data analysis of a cyber security scenario. Using cross validation, we explore the effects of different interaction behaviors. Preliminary results indicate a 70% accuracy in identifying inflection points. These preliminary results suggest the feasibility of data-driven approaches in furthering our understanding regarding sense- making and interaction provenance in visual analytics.

In User Interactions for Building Knowledge (UIBK) Workshop, ACM Intelligent User Interfaces (IUI) Proceedings
Alyssa Peña
Big Data Engineer

I have a B.S. in Civil Engineering and a M.S. in Visualization from Texas A&M. Outside of work, I am participating in Georgia Tech's Online Master of Science Computer Science program to further my knowledge in Explainable AI and computer science fundamentals. In my free time I create traditional artwork, run, bike ride, and explore new places.