Recent works have explored the concept of movement correlation interfaces, in which moving objects can be selected by matching the movement of the input device to that of the desired object. Previous techniques relied on a single modality (e.g. gaze or mid-air gestures) and specific hardware to issue commands. TraceMatch is a computer vision technique that enables input by movement correlation while abstracting from any particular input modality. The technique relies only on a conventional webcam to enable users to produce matching gestures with any given body parts, even whilst holding objects. We describe an implementation of the technique for acquisition of orbiting targets, evaluate algorithm performance for different target sizes and frequencies, and demonstrate use of the technique for remote control of graphical as well as physical objects with different body parts.

Clarke, C., Bellino, A., Esteves, A., Velloso, E., Gellersen, H. (2016). TraceMatch: A computer vision technique for user input by tracing of animated controls. In UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp.298-303). Association for Computing Machinery, Inc [10.1145/2971648.2971714].

TraceMatch: A computer vision technique for user input by tracing of animated controls

BELLINO, ALESSIO
Secondo
;
2016

Abstract

Recent works have explored the concept of movement correlation interfaces, in which moving objects can be selected by matching the movement of the input device to that of the desired object. Previous techniques relied on a single modality (e.g. gaze or mid-air gestures) and specific hardware to issue commands. TraceMatch is a computer vision technique that enables input by movement correlation while abstracting from any particular input modality. The technique relies only on a conventional webcam to enable users to produce matching gestures with any given body parts, even whilst holding objects. We describe an implementation of the technique for acquisition of orbiting targets, evaluate algorithm performance for different target sizes and frequencies, and demonstrate use of the technique for remote control of graphical as well as physical objects with different body parts.
paper
computer vision, gesture input, input techniques, motion matching, path mimicry, remote control, ubiquitous computing, user input, vision-based interfaces
English
ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2016 12-16 September
2016
UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing
9781450344616
2016
298
303
none
Clarke, C., Bellino, A., Esteves, A., Velloso, E., Gellersen, H. (2016). TraceMatch: A computer vision technique for user input by tracing of animated controls. In UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp.298-303). Association for Computing Machinery, Inc [10.1145/2971648.2971714].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/131702
Citazioni
  • Scopus 38
  • ???jsp.display-item.citation.isi??? 25
Social impact