http://www.idiap.ch/uist2006/ Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input en Tue, 17 Oct 2006 00:00:00 +0200 no Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input 00:00:07 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Robust Computer Vision Based Detection of Pinching for One and Two Handed Gesture Input Andy Wilson Microsoft Research Robust Computer Vision Based Detection of Pinching for One and Two Handed Gesture Input Andy Wilson Microsoft Research 00:00:08 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Robust Computer Vision Based Detection of Pinching for One and Two-Handed Gesture Input Andy Wilson Microsoft Research Robust Computer Vision Based Detection of Pinching for One and Two-Handed Gesture Input Andy Wilson Microsoft Research 00:00:41 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 A common problem in vision based HCI racking the hands, but how to drop A common problem in vision based HCI racking the hands, but how to drop 00:00:43 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 A common problem in vision based HCI racking the hands, but how to drop How to get to Buxton s 3 state model selection tracking A common problem in vision based HCI racking the hands, but how to drop How to get to Buxton s 3 state model selection tracking 00:00:37 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 A common problem in vision based HCI racking the hands, but how to drop How to get to Buxton s 3 state model selection tracking pen up pen down hands off movwng A common problem in vision based HCI racking the hands, but how to drop How to get to Buxton s 3 state model selection tracking pen up pen down hands off movwng 00:00:15 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Pinching touching thumb and forefinger Unambiguous to the user Discrete signal maps to discrete input Stable transition in and out Pinching touching thumb and forefinger Unambiguous to the user Discrete signal maps to discrete input Stable transition in and out 00:00:52 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Discrete sensing for discrete state not clicked button state L clicked closed hand hand size open hand not pinched pinch state L pinched Discrete sensing for discrete state not clicked button state L clicked closed hand hand size open hand not pinched pinch state L pinched 00:01:05 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Pinching touching thumb and forefinger Ergonomics Natural ana ogues Tugging on a piece of fabnc Using a stylus Picking up a small object Pinching touching thumb and forefinger Ergonomics Natural ana ogues Tugging on a piece of fabnc Using a stylus Picking up a small object 00:00:32 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Some previous pinching work Fakespace Pinch Gloves VideoDesk Myron Krueger Visual TouchPad Malik and Laszio Sato et al demo this conference Some previous pinching work Fakespace Pinch Gloves VideoDesk Myron Krueger Visual TouchPad Malik and Laszio Sato et al demo this conference 00:00:22 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Some previous pinching work Fakespace Pinch Gloves VideoDesk Myron Krueger Visual TouchPad Malik and Laszio Sato et al demo this conference Some previous pinching work Fakespace Pinch Gloves VideoDesk Myron Krueger Visual TouchPad Malik and Laszio Sato et al demo this conference 00:00:06 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Some previous pinching work Fakespace Pinch Gloves VideoDesk Myron Krueger Visual TouchPad Malik and Laszlo Sato et al demo this conference Some previous pinching work Fakespace Pinch Gloves VideoDesk Myron Krueger Visual TouchPad Malik and Laszlo Sato et al demo this conference 00:00:47 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Above the keyboard vision Kjeldsen Kender Quek Mysliwiec, FingerMouse Wilson Cutrell, FlowMouse Above the keyboard vision Kjeldsen Kender Quek Mysliwiec, FingerMouse Wilson Cutrell, FlowMouse 00:00:42 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Recognition problem Recognition problem 00:00:07 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Recognition problem Recognition problem 00:00:19 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Recognition problem Recognition problem 00:00:17 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 The technique The technique 00:00:48 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Connected components Consider an image as an undirected graph where each node corresponds to a pixel, and each node has edges to nelghborlng nodes ptxels of the same A set of pixeis is a connected component if for every pair of plxets u and v there is A connected component can often correspond to a distinct object Connected components Consider an image as an undirected graph where each node corresponds to a pixel, and each node has edges to nelghborlng nodes ptxels of the same A set of pixeis is a connected component if for every pair of plxets u and v there is A connected component can often correspond to a distinct object 00:00:41 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Image processing Image processing 00:00:06 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Image processing Background subtraction Connected components analysis Image processing Background subtraction Connected components analysis 00:00:07 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Image processing Background subtraction Connected components analysis Count the number of components, pick the smallest Image processing Background subtraction Connected components analysis Count the number of components, pick the smallest 00:01:06 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input 00:00:12 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input 00:01:07 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 QIDID QIDID 00:00:13 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Limitations Limitations 00:00:06 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Limitations Only as robust as the segmentation Limitations Only as robust as the segmentation 00:01:10 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Limitations Only as robust as the segmentation Dependent on ine of sight Not a fu 3-state interaction model Limitations Only as robust as the segmentation Dependent on ine of sight Not a fu 3-state interaction model 00:00:51 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Conclusion Simple image processing technique to detect pinching Conclusion Simple image processing technique to detect pinching 00:00:07 no Andrew Wilson, Microsoft Research Wed, 18 Oct 2006 00:00:00 +0200 Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input SCIENCE > 2006 Conclusion Simple image processing technique to detect pinching A nice example of when an interaction technique and a recognition technique interlock Conclusion Simple image processing technique to detect pinching A nice example of when an interaction technique and a recognition technique interlock 00:02:00 no Andrew Wilson, Microsoft Research