http://www.idiap.ch/uist2006/ Interactive Environment-Aware Display Bubbles en Tue, 17 Oct 2006 00:00:00 +0200 no Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interactive environment-aware display bubbles Daniel Cotting and Markus Gross Computer Graphics Laboratory ETH Zurich Switzerland Interactive environment-aware display bubbles Daniel Cotting and Markus Gross Computer Graphics Laboratory ETH Zurich Switzerland 00:00:16 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Motivation Novel display metaphor m Displays anywhere Freeform shape D Environment-aware Matching set of inter- action schemes D Increased. and adaptivity Motivation Novel display metaphor m Displays anywhere Freeform shape D Environment-aware Matching set of inter- action schemes D Increased. and adaptivity 00:00:50 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Motivation In presence of clutter and obstacles Tighter geometric packing than rectangular displays Use limited display space more effectively Motivation In presence of clutter and obstacles Tighter geometric packing than rectangular displays Use limited display space more effectively 00:00:41 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Motivation Empty working environments Tile a nd a rra nge a very la rge n umber of displays in a space-efficient manner B Maximize surface usage in an optimal way Motivation Empty working environments Tile a nd a rra nge a very la rge n umber of displays in a space-efficient manner B Maximize surface usage in an optimal way 00:00:18 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Motivation Empty working environments Consider freeform user-defined information focus Contrary to the cascading, tiling or overlapping of traditional rectangular windows More relevant information can be visualized in parallel while keeping helpful context data Motivation Empty working environments Consider freeform user-defined information focus Contrary to the cascading, tiling or overlapping of traditional rectangular windows More relevant information can be visualized in parallel while keeping helpful context data 00:00:21 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Related work Widearea screens and tabletop systems Focus context visualization and warping User-defined displays D Pinhanez 2001, Tokuda et al. 2003, Borkowski et al. 2003, Butz et al. 2004, Ehnes et al. 2004, Cotting et a l. 2005 Drawbacks Rectangular settings, single projectors or bad scalability, motorized equipment, no enviro nment-awareness. Related work Widearea screens and tabletop systems Focus context visualization and warping User-defined displays D Pinhanez 2001, Tokuda et al. 2003, Borkowski et al. 2003, Butz et al. 2004, Ehnes et al. 2004, Cotting et a l. 2005 Drawbacks Rectangular settings, single projectors or bad scalability, motorized equipment, no enviro nment-awareness. 00:01:10 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Overview Setting Display bubbles Warping of display content Interaction Environment-aware adaptivity Applications Conclusions future work Overview Setting Display bubbles Warping of display content Interaction Environment-aware adaptivity Applications Conclusions future work 00:00:53 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Setting MCU Setting MCU 00:01:19 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Overview Setting Display bubbles Warping of display content Interaction Environment-aware adaptivity Applications Conclusions future work Overview Setting Display bubbles Warping of display content Interaction Environment-aware adaptivity Applications Conclusions future work 00:00:08 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Display content Distributed display content Multi-protocol, multi-display bubble content Include any portable computer as a source Widget Display content Distributed display content Multi-protocol, multi-display bubble content Include any portable computer as a source Widget 00:00:04 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Display content Distributed display content Multi-protocol, multi-display bubble content Include any portable computer as a source Widlget Bubble Display content Distributed display content Multi-protocol, multi-display bubble content Include any portable computer as a source Widlget Bubble 00:00:04 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Display content Distributed display content Multi-protocol, multi-display bubble content Include any portable computer as a source Awamtr, st J.d, bam Display content Distributed display content Multi-protocol, multi-display bubble content Include any portable computer as a source Awamtr, st J.d, bam 00:00:10 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Display content Distributed display content Multi-protocol, multi-display bubble content Include any portable computer as a source Bubble Display content Distributed display content Multi-protocol, multi-display bubble content Include any portable computer as a source Bubble 00:00:07 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Display content Distributed display content Multi-protocol, multi-display bubble content Include any portable computer as a source Display content Distributed display content Multi-protocol, multi-display bubble content Include any portable computer as a source 00:00:04 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Display content In the future GUI design should be adapted to the requirements of non-rectangular displays II In the meantime, a warping approach to arbitrary concaveshapes becomes necessary Display content In the future GUI design should be adapted to the requirements of non-rectangular displays II In the meantime, a warping approach to arbitrary concaveshapes becomes necessary 00:00:44 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Warping Potential-based method Guarantees a smooth deformation Elegantly preserves the specific boundary conditions Warping Potential-based method Guarantees a smooth deformation Elegantly preserves the specific boundary conditions 00:00:21 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Warping Focus and context mapping along field lines Hyperbolic projection approach Ensures visual continuity Warping Focus and context mapping along field lines Hyperbolic projection approach Ensures visual continuity 00:00:21 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Warping Mapping along field lines Alternative constrained width of context area C Shape continuum defined by user parameter Warping Mapping along field lines Alternative constrained width of context area C Shape continuum defined by user parameter 00:00:51 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Overview Q Setting Display bubbles Warping of display content Interaction Environment-aware adaptivity Applications Conclusions future work Overview Q Setting Display bubbles Warping of display content Interaction Environment-aware adaptivity Applications Conclusions future work 00:00:10 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Laser pointer Support for multiple users large range of operation No invasive or expensive equipment Efficient and reliable tracking Interaction Laser pointer Support for multiple users large range of operation No invasive or expensive equipment Efficient and reliable tracking 00:00:07 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Laser pointer Support for multiple users large range of operation No invasive or expensive eq uipment Efficient and reliable tracking Interaction Laser pointer Support for multiple users large range of operation No invasive or expensive eq uipment Efficient and reliable tracking 00:00:26 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Circular pie menu Orientation-independent view Inexperienced Visual feedback Advanced Gesture-like shortcuts Interaction Circular pie menu Orientation-independent view Inexperienced Visual feedback Advanced Gesture-like shortcuts 00:00:23 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Warping operations Freeform editing Rectangle alignment E Focus change Potential variation Interaction Warping operations Freeform editing Rectangle alignment E Focus change Potential variation 00:00:31 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Deng aoe Interaction Deng aoe 00:00:09 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Interacbon rang started Interaction Interacbon rang started 00:00:05 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Warping operations Freeform editing Rectangle alignment D Focus change Potential variation Interaction Warping operations Freeform editing Rectangle alignment D Focus change Potential variation 00:00:07 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Warping operations Freeform editing Rectangle alignment E Focus change B Potential variation Interaction Warping operations Freeform editing Rectangle alignment E Focus change B Potential variation 00:00:05 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Warping operations Freeform editing U Rectangle alignment D Focus change Potential variation Interaction Warping operations Freeform editing U Rectangle alignment D Focus change Potential variation 00:00:05 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Warping operations Fmeform editing U Rectangle alignment g Focus change Potential variation Interaction Warping operations Fmeform editing U Rectangle alignment g Focus change Potential variation 00:00:06 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Warping operations Freeform editing U Rectangle alignment B Focus change Potential variation Interaction Warping operations Freeform editing U Rectangle alignment B Focus change Potential variation 00:00:05 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Warping operations Fmeform editing U Rectangle alignment Focus change Potential variation Interaction Warping operations Fmeform editing U Rectangle alignment Focus change Potential variation 00:00:05 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Warping operations Freeform editing U Rectangle alignment E Focus change B Potential variation Interaction Warping operations Freeform editing U Rectangle alignment E Focus change B Potential variation 00:00:23 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Bubble arrangement Affine transformation Grouping Cardinality chanse Instantiation Deletion Cut pasting Interaction Bubble arrangement Affine transformation Grouping Cardinality chanse Instantiation Deletion Cut pasting 00:00:09 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Bubble arrangement Affine transformation Grouping Cardinality change Instantiation Deletion Cut pasting Interaction Bubble arrangement Affine transformation Grouping Cardinality change Instantiation Deletion Cut pasting 00:00:08 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Bubble arrangement Affine transformation Grouping Cardinality change Instantiation Deletion Cut pasting Interaction Bubble arrangement Affine transformation Grouping Cardinality change Instantiation Deletion Cut pasting 00:00:08 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Bubble arrangement Affine transformation Grouping Cardinality chanse Instantiation Deletion Cut pasting Interaction Bubble arrangement Affine transformation Grouping Cardinality chanse Instantiation Deletion Cut pasting 00:00:10 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Bubble arrangement Affine transformation Grouping Cardinality change Instantiation Deletion Cut pasting Interaction Bubble arrangement Affine transformation Grouping Cardinality change Instantiation Deletion Cut pasting 00:00:39 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Application interface Mouse navigation Keyboard tracing Annotation Content cycling Interaction Application interface Mouse navigation Keyboard tracing Annotation Content cycling 00:00:05 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Application interface Mouse navigation Keyboa rd tracing Annotation Content cycling Interaction Application interface Mouse navigation Keyboa rd tracing Annotation Content cycling 00:00:14 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Application interface Mouse navigation Keyboard tracing Annotation Content cycling Interaction Application interface Mouse navigation Keyboard tracing Annotation Content cycling 00:00:05 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Interaction Application interface Mouse navigation Keyboard tracing Annotation Content cycling Interaction Application interface Mouse navigation Keyboard tracing Annotation Content cycling 00:00:05 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Overview Setting Display bubbles Warping of display content Interaction Environment-aware adaptivity Applications Conclusions future work Overview Setting Display bubbles Warping of display content Interaction Environment-aware adaptivity Applications Conclusions future work 00:00:09 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Environment-aware adaptivity Continuous extraction of the projection surface properties Based on imperceptible structured light Using Gabor filtering Environment-aware adaptivity Continuous extraction of the projection surface properties Based on imperceptible structured light Using Gabor filtering 00:00:36 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Environment-aware adaptivity React to collisions and avoid shadows Relocate Reshape Environment-aware adaptivity React to collisions and avoid shadows Relocate Reshape 00:00:12 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Environment-aware adaptivity React to collisions and avoid shadows Relocate Reshape Environment-aware adaptivity React to collisions and avoid shadows Relocate Reshape 00:00:59 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Overview Q Setting Display bubbles Warping of display content Interaction Environment-aware adaptivity Applications Conclusions future work Overview Q Setting Display bubbles Warping of display content Interaction Environment-aware adaptivity Applications Conclusions future work 00:00:08 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Applications Application scenarios Collaborative design, engineering, modeling and visualization Applications Application scenarios Collaborative design, engineering, modeling and visualization 00:00:14 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Applications Application scenarios Collaborative design, engineering, modeling and visualization Applications Application scenarios Collaborative design, engineering, modeling and visualization 00:00:06 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Applications Application scenarios Collaborative design, engineering, modeling and visualization Applications Application scenarios Collaborative design, engineering, modeling and visualization 00:00:31 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Applications Application scenarios Presentation meetings, edutainment and brainstorming sessions Applications Application scenarios Presentation meetings, edutainment and brainstorming sessions 00:00:33 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Applications Application scenarios Single-user large scale workspaces in office environments Applications Application scenarios Single-user large scale workspaces in office environments 00:00:08 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Applications Application scenarios Single-user large scale workspaces in office environments Applications Application scenarios Single-user large scale workspaces in office environments 00:00:09 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Applications Application scenarios Single-user large scale workspaces in office environments Applications Application scenarios Single-user large scale workspaces in office environments 00:00:09 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Usability study preview 60 participants 6 scenarios I tasks Various aspects of the display metaphor Laser- poer na12ztlon Pie metm Usability study preview 60 participants 6 scenarios I tasks Various aspects of the display metaphor Laser- poer na12ztlon Pie metm 00:00:23 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Usability study preview 0 Summary of findings Wide acceptance of metaphor As effective and efficient as traditional, well-known settings even for inexperienced users Better usage of limited space Improvements necessary for better collaboration Minor implementation issues Details in future publication Usability study preview 0 Summary of findings Wide acceptance of metaphor As effective and efficient as traditional, well-known settings even for inexperienced users Better usage of limited space Improvements necessary for better collaboration Minor implementation issues Details in future publication 00:00:48 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Conclusions Contributions Warping of displays to arbitrary shapes using a novel focus and context display technique Matching set of interaction operations Environment-aware adaptivity Lift shape, placement, collaboration and interaction restrictions of current systems Conclusions Contributions Warping of displays to arbitrary shapes using a novel focus and context display technique Matching set of interaction operations Environment-aware adaptivity Lift shape, placement, collaboration and interaction restrictions of current systems 00:00:31 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Future work Direct hand finger gestures bi-manual Explore additional bubble operations More elaborate automatic display initializ- ation, adaptivity and rearrangement schemes Content initialization based on user recognition and modeling Rethink the common rigid rectangular layout mmut-Awam tr, sp m.d, bam Future work Direct hand finger gestures bi-manual Explore additional bubble operations More elaborate automatic display initializ- ation, adaptivity and rearrangement schemes Content initialization based on user recognition and modeling Rethink the common rigid rectangular layout mmut-Awam tr, sp m.d, bam 00:00:37 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland Wed, 18 Oct 2006 00:00:00 +0200 Interactive Environment-Aware Display Bubbles SCIENCE > 2006 Thank you for your attention Thank you for your attention 00:06:38 no Daniel Cotting, Markus Gross, ETH Zurich, Switzerland