Visualizations


Input analytics

Analyzing mouse and keyboard input streams to identify strategy and deceptive behavior in a casual game setting (funded research project).

Replay of a participant playing the concentration game, showing mouse traces and clicks
Visualizing mouse traces in a static image
Visualizing mouse traces in a static image, with color representing velocity and arrows to indicated direction; other significant events also marked (click, match, mismatch, etc.)

Neuronal processing

Visualizing real-time operation of a neuronal architecture as it processes an image stream to perform a visual search task (dissertation research).

Top-left: Image input; Top-right: What the simulated retina sees with foveal image inset; Bottom-left: Neuron action potentials as they fire; Bottom-right: Final output showing image salience and visual search result
Features computed on a sample of images from the COIL-100 dataset
Features computed on a sample of images from the COIL-100 dataset
Images laid out in 2-D space using multidimensional scaling (MDS) on their feature vectors
Images laid out in 2-D space using multidimensional scaling (MDS) on their feature vectors

Augmented reality

Real-time projection of 3-D objects and data distributions within a freely manipulable physical wireframe cube (pilot HCI project).

Bimanual interaction with the cube, showing a water molecule and a benzene molecule projected inside, and a Phantom Omni from SensAble Technologies being used as a pointing device (with haptic feedback)
Model of a human heart   A radial tree
Many different items can be projected within the cube, including anatomical models (left, model of a human heart) and complex 3-D structures (right, a radial tree)
Tracking changes in cube orientation
Tracking changes in cube orientation during a window of manipulation