ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models http://www.idiap.ch/uist2006/ ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models en Tue, 17 Oct 2006 00:00:00 +0200 no Capturing Freehand Annotations and Edits on Physical Models MAIL ClS ICsiv. of U Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Capturing Freehand Annotations and Edits on Physical Models MAIL ClS ICsiv. of U Capturing Freehand Annotations and Edits on Physical Models MAIL ClS ICsiv. of U 00:00:09 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park ModeiCraft Capturing Freehand Annotations and Edits on Physical Models Hyunvoun Son F cois Guimbretiere HCI Lab MAE. CIS Conqpmer Science Dept. Cornelil niversitv Qt niv. of Maryland Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 ModeiCraft Capturing Freehand Annotations and Edits on Physical Models Hyunvoun Son F cois Guimbretiere HCI Lab MAE. CIS Conqpmer Science Dept. Cornelil niversitv Qt niv. of Maryland ModeiCraft Capturing Freehand Annotations and Edits on Physical Models Hyunvoun Son F cois Guimbretiere HCI Lab MAE. CIS Conqpmer Science Dept. Cornelil niversitv Qt niv. of Maryland 00:00:20 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Motivation 17 Design process is becoming digital 13 Emergence of 3D prototype technique Hearst building designed by Sir Foster Courtesy of and Faer UNIVEILS ITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Motivation 17 Design process is becoming digital 13 Emergence of 3D prototype technique Hearst building designed by Sir Foster Courtesy of and Faer UNIVEILS ITY OF Motivation 17 Design process is becoming digital 13 Emergence of 3D prototype technique Hearst building designed by Sir Foster Courtesy of and Faer UNIVEILS ITY OF 00:00:53 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Motivation Lower cost of 3D models More accessible UNIVERSITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Motivation Lower cost of 3D models More accessible UNIVERSITY OF Motivation Lower cost of 3D models More accessible UNIVERSITY OF 00:00:19 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Motivation Lower cost of 3D models More accessible How to capbure these annotations back to the digital UNIVERSITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Motivation Lower cost of 3D models More accessible How to capbure these annotations back to the digital UNIVERSITY OF Motivation Lower cost of 3D models More accessible How to capbure these annotations back to the digital UNIVERSITY OF 00:00:28 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Contributions Capture sketches made on 3D model Annotabons and edits IZI Merged back into the original CAD model Annotations are presented in context Edits are executed automatically Easy setup Portable Scalable G LIVER, SITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Contributions Capture sketches made on 3D model Annotabons and edits IZI Merged back into the original CAD model Annotations are presented in context Edits are executed automatically Easy setup Portable Scalable G LIVER, SITY OF Contributions Capture sketches made on 3D model Annotabons and edits IZI Merged back into the original CAD model Annotations are presented in context Edits are executed automatically Easy setup Portable Scalable G LIVER, SITY OF 00:00:41 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park ModelCraff 13 SolidWorks PlugIn Digital Pen and Paper models Logitech IOz Anoto pattern on the surface of the models UNITEILS ITT OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 ModelCraff 13 SolidWorks PlugIn Digital Pen and Paper models Logitech IOz Anoto pattern on the surface of the models UNITEILS ITT OF ModelCraff 13 SolidWorks PlugIn Digital Pen and Paper models Logitech IOz Anoto pattern on the surface of the models UNITEILS ITT OF 00:00:43 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park ModelCraft 13 SolidWorks Plugn Digital Pen and Paper models Logitech IOz Anoto pattern on the surface of the models UNIVEKSITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 ModelCraft 13 SolidWorks Plugn Digital Pen and Paper models Logitech IOz Anoto pattern on the surface of the models UNIVEKSITY OF ModelCraft 13 SolidWorks Plugn Digital Pen and Paper models Logitech IOz Anoto pattern on the surface of the models UNIVEKSITY OF 00:00:06 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park UIITERS ITT OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 UIITERS ITT OF UIITERS ITT OF 00:00:07 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park MARYLAND Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 MARYLAND MARYLAND 00:00:26 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models 00:00:06 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models 00:00:44 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models 00:00:53 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park MARYLAND Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 MARYLAND MARYLAND 00:00:05 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models 00:00:04 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models 00:00:06 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park MARYLAND Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 MARYLAND MARYLAND 00:02:10 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Slkle Show UIST fi. Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Slkle Show UIST fi. Slkle Show UIST fi. 00:00:05 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park UN IVEILS ITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 UN IVEILS ITY OF UN IVEILS ITY OF 00:00:04 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park n Painting on 3D objects surfact Tracking infrastructure Agrawala et al, 1995 Augmented Reality Grasset et al, 2005 EI Sketching System Teddy Igarashi, et al 1999 SKETCH Zeleznik, et al. 1996 SketchUp LNIVER, SITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 n Painting on 3D objects surfact Tracking infrastructure Agrawala et al, 1995 Augmented Reality Grasset et al, 2005 EI Sketching System Teddy Igarashi, et al 1999 SKETCH Zeleznik, et al. 1996 SketchUp LNIVER, SITY OF n Painting on 3D objects surfact Tracking infrastructure Agrawala et al, 1995 Augmented Reality Grasset et al, 2005 EI Sketching System Teddy Igarashi, et al 1999 SKETCH Zeleznik, et al. 1996 SketchUp LNIVER, SITY OF 00:00:58 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Related Work Tangible User Interfaces URP Underkoffler and Lshii, 1998 Illuminating Clay Piper et al. 2002 Gestural 3D modeling Sheng 2005 Paper and Pen Interface PADD Guimbretiere 2003 PapierCraft Uao, et al. 2005 Q UNiYEKSITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Related Work Tangible User Interfaces URP Underkoffler and Lshii, 1998 Illuminating Clay Piper et al. 2002 Gestural 3D modeling Sheng 2005 Paper and Pen Interface PADD Guimbretiere 2003 PapierCraft Uao, et al. 2005 Q UNiYEKSITY OF Related Work Tangible User Interfaces URP Underkoffler and Lshii, 1998 Illuminating Clay Piper et al. 2002 Gestural 3D modeling Sheng 2005 Paper and Pen Interface PADD Guimbretiere 2003 PapierCraft Uao, et al. 2005 Q UNiYEKSITY OF 00:00:50 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Related Work DUsing ModelCraff Behind the Curtain User Study Discussion Future Work UITERS ITT OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Related Work DUsing ModelCraff Behind the Curtain User Study Discussion Future Work UITERS ITT OF Related Work DUsing ModelCraff Behind the Curtain User Study Discussion Future Work UITERS ITT OF 00:00:13 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Typical usage scenario 13 Eady stages of design D Rapid prototyping Q UN ITEILS E I OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Typical usage scenario 13 Eady stages of design D Rapid prototyping Q UN ITEILS E I OF Typical usage scenario 13 Eady stages of design D Rapid prototyping Q UN ITEILS E I OF 00:00:13 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Getting Started ModelCraft PlugIn for SolidWorks SolidWorks model Build and annotate with dijital pen on Anoto paper LCEVERSITY CF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Getting Started ModelCraft PlugIn for SolidWorks SolidWorks model Build and annotate with dijital pen on Anoto paper LCEVERSITY CF Getting Started ModelCraft PlugIn for SolidWorks SolidWorks model Build and annotate with dijital pen on Anoto paper LCEVERSITY CF 00:00:34 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Annotations and Commands Annotation blue pen LIVERSITT OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Annotations and Commands Annotation blue pen LIVERSITT OF Annotations and Commands Annotation blue pen LIVERSITT OF 00:00:05 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Annotations and Commands Annotation blue pen Command- red pen G L.I VER, S ITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Annotations and Commands Annotation blue pen Command- red pen G L.I VER, S ITY OF Annotations and Commands Annotation blue pen Command- red pen G L.I VER, S ITY OF 00:00:10 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Annotations and Commands D Annotation blue pen Command- red pen Parameters Strokes on surfaces L, NIVER, SITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Annotations and Commands D Annotation blue pen Command- red pen Parameters Strokes on surfaces L, NIVER, SITY OF Annotations and Commands D Annotation blue pen Command- red pen Parameters Strokes on surfaces L, NIVER, SITY OF 00:00:12 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Annotations and Commands D Annotation blue pen Command- red pen LIRLI JS Parameters Strokes on surfaces Pigtail delimiter 17 Similar to Scriboli Hinctdey et al 05 Basetine for character orientation Callout fur small sketch Indicate insideoutside L IVER, S ITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Annotations and Commands D Annotation blue pen Command- red pen LIRLI JS Parameters Strokes on surfaces Pigtail delimiter 17 Similar to Scriboli Hinctdey et al 05 Basetine for character orientation Callout fur small sketch Indicate insideoutside L IVER, S ITY OF Annotations and Commands D Annotation blue pen Command- red pen LIRLI JS Parameters Strokes on surfaces Pigtail delimiter 17 Similar to Scriboli Hinctdey et al 05 Basetine for character orientation Callout fur small sketch Indicate insideoutside L IVER, S ITY OF 00:00:33 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Annotations and Commands Annotation blue pen Command- red pen Parameters Strokes on surfaces Pigtail delimiter Similar to Scribali Hinctdey et al 05 Baseline for character orientation Callout for small sketch Indicate insideoutside Command letter Q UNIVEILS ITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Annotations and Commands Annotation blue pen Command- red pen Parameters Strokes on surfaces Pigtail delimiter Similar to Scribali Hinctdey et al 05 Baseline for character orientation Callout for small sketch Indicate insideoutside Command letter Q UNIVEILS ITY OF Annotations and Commands Annotation blue pen Command- red pen Parameters Strokes on surfaces Pigtail delimiter Similar to Scribali Hinctdey et al 05 Baseline for character orientation Callout for small sketch Indicate insideoutside Command letter Q UNIVEILS ITY OF 00:00:17 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Models and Operations Note Taking Cut Th rough Cut To Depth Grooving LNIVERSITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Models and Operations Note Taking Cut Th rough Cut To Depth Grooving LNIVERSITY OF Models and Operations Note Taking Cut Th rough Cut To Depth Grooving LNIVERSITY OF 00:00:29 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Portable E3 Using External Reference Fitting a cube around a door frame Take the model away from computer and edit UNIVERSITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Portable E3 Using External Reference Fitting a cube around a door frame Take the model away from computer and edit UNIVERSITY OF Portable E3 Using External Reference Fitting a cube around a door frame Take the model away from computer and edit UNIVERSITY OF 00:00:20 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Freespace Interaction Extrusion Augmented Ruler UNIVERSITT OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Freespace Interaction Extrusion Augmented Ruler UNIVERSITT OF Freespace Interaction Extrusion Augmented Ruler UNIVERSITT OF 00:00:35 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Design Cycle of a Model Virtual World Physical World CAD Program Card exeation Synchronization UITERSITT OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Design Cycle of a Model Virtual World Physical World CAD Program Card exeation Synchronization UITERSITT OF Design Cycle of a Model Virtual World Physical World CAD Program Card exeation Synchronization UITERSITT OF 00:01:02 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Command Recognition Down-sample Super-sample Tune for SolidWorks Apply H i. Face.T.D ii. timestamp L.4 VERSITY F Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Command Recognition Down-sample Super-sample Tune for SolidWorks Apply H i. Face.T.D ii. timestamp L.4 VERSITY F Command Recognition Down-sample Super-sample Tune for SolidWorks Apply H i. Face.T.D ii. timestamp L.4 VERSITY F 00:00:52 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park User Study Six semi-structured interviews Demonstration and hands-on test 13 Partidpants Professional architects Senior partner, Drafter, Designer Architecture Education 12 Professor, Students UNIVERSITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 User Study Six semi-structured interviews Demonstration and hands-on test 13 Partidpants Professional architects Senior partner, Drafter, Designer Architecture Education 12 Professor, Students UNIVERSITY OF User Study Six semi-structured interviews Demonstration and hands-on test 13 Partidpants Professional architects Senior partner, Drafter, Designer Architecture Education 12 Professor, Students UNIVERSITY OF 00:00:18 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park User Feedback 1 12I Professional Architects BeeryRio Useful for early iteration stage 4- Rapid Protutyping Less useful for later stages 3D CAD Lack accuracy Courtesy of Rosana Keleher, BeeryRio UNIVERSITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 User Feedback 1 12I Professional Architects BeeryRio Useful for early iteration stage 4- Rapid Protutyping Less useful for later stages 3D CAD Lack accuracy Courtesy of Rosana Keleher, BeeryRio UNIVERSITY OF User Feedback 1 12I Professional Architects BeeryRio Useful for early iteration stage 4- Rapid Protutyping Less useful for later stages 3D CAD Lack accuracy Courtesy of Rosana Keleher, BeeryRio UNIVERSITY OF 00:00:44 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park User Feedback 2 In architectural education More involved in iteration of design cycle Simple command language El Developing 3D concepts Q Pen tracking problem Thinking tn 3D ex operation to explore Q UNIVEILS ITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 User Feedback 2 In architectural education More involved in iteration of design cycle Simple command language El Developing 3D concepts Q Pen tracking problem Thinking tn 3D ex operation to explore Q UNIVEILS ITY OF User Feedback 2 In architectural education More involved in iteration of design cycle Simple command language El Developing 3D concepts Q Pen tracking problem Thinking tn 3D ex operation to explore Q UNIVEILS ITY OF 00:01:05 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Tracking Performance 13 Anoto Pattern 1 mm predsion for recagnition Designed fur 2D Curvature radius 12 mm radius of curvature 13 Non-developable surface Possible Solution DataGlyph UNIVERSITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Tracking Performance 13 Anoto Pattern 1 mm predsion for recagnition Designed fur 2D Curvature radius 12 mm radius of curvature 13 Non-developable surface Possible Solution DataGlyph UNIVERSITY OF Tracking Performance 13 Anoto Pattern 1 mm predsion for recagnition Designed fur 2D Curvature radius 12 mm radius of curvature 13 Non-developable surface Possible Solution DataGlyph UNIVERSITY OF 00:00:23 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Tracking Performance 13 Anoto Pattern 1 mm precision for recognition Designed for 2D Curvature radius 12 mm radius of curvature Non-developable surface Possible Solution DataGlyph UNIVERSITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Tracking Performance 13 Anoto Pattern 1 mm precision for recognition Designed for 2D Curvature radius 12 mm radius of curvature Non-developable surface Possible Solution DataGlyph UNIVERSITY OF Tracking Performance 13 Anoto Pattern 1 mm precision for recognition Designed for 2D Curvature radius 12 mm radius of curvature Non-developable surface Possible Solution DataGlyph UNIVERSITY OF 00:00:33 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Shape of the Models Extend Unfold to enable Model with complex shape Overlap of patches Difficult to assemble patches Larger objects with various topology Generalize the Unfolding Process Mitani and Suzuki, 2004 UtTEILS ETY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Shape of the Models Extend Unfold to enable Model with complex shape Overlap of patches Difficult to assemble patches Larger objects with various topology Generalize the Unfolding Process Mitani and Suzuki, 2004 UtTEILS ETY OF Shape of the Models Extend Unfold to enable Model with complex shape Overlap of patches Difficult to assemble patches Larger objects with various topology Generalize the Unfolding Process Mitani and Suzuki, 2004 UtTEILS ETY OF 00:01:02 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Building the model I Materials Paper models Decal mapped on a model Automated the assembly LIIVERSIT OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Building the model I Materials Paper models Decal mapped on a model Automated the assembly LIIVERSIT OF Building the model I Materials Paper models Decal mapped on a model Automated the assembly LIIVERSIT OF 00:00:22 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Building the model II 3D printing with ZCorp Z510 CMY Does not use black K Resolution marginal due to bleeding Compatible with DataGlyph UITIEILS ETY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Building the model II 3D printing with ZCorp Z510 CMY Does not use black K Resolution marginal due to bleeding Compatible with DataGlyph UITIEILS ETY OF Building the model II 3D printing with ZCorp Z510 CMY Does not use black K Resolution marginal due to bleeding Compatible with DataGlyph UITIEILS ETY OF 00:00:31 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Pen Feedback Batch Synchronization Take the model tu field, dient rneettings Feedback Ink laid on the surface UNIVERS ITT OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Pen Feedback Batch Synchronization Take the model tu field, dient rneettings Feedback Ink laid on the surface UNIVERS ITT OF Pen Feedback Batch Synchronization Take the model tu field, dient rneettings Feedback Ink laid on the surface UNIVERS ITT OF 00:00:17 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Pen Feedback Batch Synchronization Take the model to field, dient meebngs Feedback Ink laid on the surface Real-time feedback system UITERSETY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Pen Feedback Batch Synchronization Take the model to field, dient meebngs Feedback Ink laid on the surface Real-time feedback system UITERSETY OF Pen Feedback Batch Synchronization Take the model to field, dient meebngs Feedback Ink laid on the surface Real-time feedback system UITERSETY OF 00:00:08 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Conclusion 13 Tangible 3D sketch capture system Map 2D pattern to 3D model Digital Pen Easy SetupScalabilityPortability Positive user feedback Useful in eaHy stages of design Next step Extended user evaluation Q Teaching Professional architects UITERSITT OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Conclusion 13 Tangible 3D sketch capture system Map 2D pattern to 3D model Digital Pen Easy SetupScalabilityPortability Positive user feedback Useful in eaHy stages of design Next step Extended user evaluation Q Teaching Professional architects UITERSITT OF Conclusion 13 Tangible 3D sketch capture system Map 2D pattern to 3D model Digital Pen Easy SetupScalabilityPortability Positive user feedback Useful in eaHy stages of design Next step Extended user evaluation Q Teaching Professional architects UITERSITT OF 00:00:29 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Acknowledgements Microsoft Research NSF Grant IIS-0447703 Beery Rio Rosana Keleher E3 DMJM HN Irena Savakova E3 Special Thanks Chunyuan Uao, Nicholas Chen Ben Bederson, Bobby Bhattacharjee, Bill Pugh Adam Bender Corinna Lockenhoff LIVERSITY OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Acknowledgements Microsoft Research NSF Grant IIS-0447703 Beery Rio Rosana Keleher E3 DMJM HN Irena Savakova E3 Special Thanks Chunyuan Uao, Nicholas Chen Ben Bederson, Bobby Bhattacharjee, Bill Pugh Adam Bender Corinna Lockenhoff LIVERSITY OF Acknowledgements Microsoft Research NSF Grant IIS-0447703 Beery Rio Rosana Keleher E3 DMJM HN Irena Savakova E3 Special Thanks Chunyuan Uao, Nicholas Chen Ben Bederson, Bobby Bhattacharjee, Bill Pugh Adam Bender Corinna Lockenhoff LIVERSITY OF 00:00:05 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park Thank you Questions Contact Info Hyunyoung Song cs.umd.edu www.cs.umd.edu hson Francois Guimbertiere www.cs.umd.edu, francois I UMD HCIL lab www.cs.umd.edu hcil UI IVER, S ITT OF Wed, 18 Oct 2006 00:00:00 +0200 ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models SCIENCE > 2006 Thank you Questions Contact Info Hyunyoung Song cs.umd.edu www.cs.umd.edu hson Francois Guimbertiere www.cs.umd.edu, francois I UMD HCIL lab www.cs.umd.edu hcil UI IVER, S ITT OF Thank you Questions Contact Info Hyunyoung Song cs.umd.edu www.cs.umd.edu hson Francois Guimbertiere www.cs.umd.edu, francois I UMD HCIL lab www.cs.umd.edu hcil UI IVER, S ITT OF 00:03:42 no Hyun Young Song, Francois Guimbretiere, Hod Lipson, Chang Hu, University of Maryland, College Park