http://www.idiap.ch/uist2006/ A Pen-top Interface for Interactive Paper en Tue, 17 Oct 2006 00:00:00 +0200 no Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Pen top Feedback for Paper based Interfaces Chunyuan Liao Francois Guimbretidre Connna Loeckenhoff Unwerslty of Maryland NatTonal InstTtute on Aging Oat 17, 2006 Pen top Feedback for Paper based Interfaces Chunyuan Liao Francois Guimbretidre Connna Loeckenhoff Unwerslty of Maryland NatTonal InstTtute on Aging Oat 17, 2006 00:01:07 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Paper based Interfaces Paper based Interfaces 00:00:10 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Paper based Interfaces Previous interfaces using normal pen paper 7 XAXJohnson, 93, PaperPDAHeiner, 99 Paper based Interfaces Previous interfaces using normal pen paper 7 XAXJohnson, 93, PaperPDAHeiner, 99 00:00:13 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Paper based Interfaces Previous interfaces using normal pen paper 7 XAXJohnson, 93, PaperPDAHeiner, 99 New interfaces using digital pens paper Paper based Interfaces Previous interfaces using normal pen paper 7 XAXJohnson, 93, PaperPDAHeiner, 99 New interfaces using digital pens paper 00:00:11 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Paper based Interfaces Previous interfaces using normal pen paper XAXJohnson, 93, PaperPDAHeiner, 99 New interfaces using digital pens paper Leapfrog FLY Pen Paper based Interfaces Previous interfaces using normal pen paper XAXJohnson, 93, PaperPDAHeiner, 99 New interfaces using digital pens paper Leapfrog FLY Pen 00:00:14 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Paper based Interfaces Previous interfaces using normal pen paper E XAXJohnson, 93, PaperPOAHelner, 99 New interfaces using digital pens paper Leapfrog FLY Pen Compati xisting pra Paper based Interfaces Previous interfaces using normal pen paper E XAXJohnson, 93, PaperPOAHelner, 99 New interfaces using digital pens paper Leapfrog FLY Pen Compati xisting pra 00:00:30 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Paper based Interfaces Previous interfaces using normal pen paper 7 XAXJohnson, 93, PaperPDAHeiner, 99 New interfaces using digital pens paper Leapfrog FLY Pen Compati Limited or inefficient feedback constrains operation complexity Paper based Interfaces Previous interfaces using normal pen paper 7 XAXJohnson, 93, PaperPDAHeiner, 99 New interfaces using digital pens paper Leapfrog FLY Pen Compati Limited or inefficient feedback constrains operation complexity 00:00:44 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 t Xlore Complex Paper Interface A gesture command system for paper Based on Anoto More interactions Stroke level interactions mode switch, gesture recognition Application level interactions copypaste, hypedink Browse, search and Copy from manage results on Paste into notepad computers synchronization t Xlore Complex Paper Interface A gesture command system for paper Based on Anoto More interactions Stroke level interactions mode switch, gesture recognition Application level interactions copypaste, hypedink Browse, search and Copy from manage results on Paste into notepad computers synchronization 00:01:12 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Challenges Not constrain the original paper affordances Extra projectors or monitors limit paper flexibility Give feedback without dynamic rendering on paper Help novice users explore the interface Help skilled users improve performance Explore applications with the paper-pen-only interface Challenges Not constrain the original paper affordances Extra projectors or monitors limit paper flexibility Give feedback without dynamic rendering on paper Help novice users explore the interface Help skilled users improve performance Explore applications with the paper-pen-only interface 00:01:04 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Proposed Solution A platform to explore paper interface feedback Structural parameters of commands Constraints and contingencies Tactile Auditory sound and speech bya PC LogltecZh 102 Digital Visual LEDs pen with Bluetooth Proposed Solution A platform to explore paper interface feedback Structural parameters of commands Constraints and contingencies Tactile Auditory sound and speech bya PC LogltecZh 102 Digital Visual LEDs pen with Bluetooth 00:00:46 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Demo Video Enhance PapierCraft with the multimodal pen Help interface exploration Help command selection Implement keyword search on a paper document Demo Video Enhance PapierCraft with the multimodal pen Help interface exploration Help command selection Implement keyword search on a paper document 00:00:14 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Demo qdeo Pen-lop Feedback for Paper-based Interfaces iunon AOlng Demo qdeo Pen-lop Feedback for Paper-based Interfaces iunon AOlng 00:02:56 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Demo Video Chunyuan Liao Nicholas Y. Chen 8 41b Yit Pha Khoo Acknowledgement Paul Dietz Th project in part by NSF Grant IIS-C414.6gg and MKmsoff Cent for Inter tcJn Descjn and Visual 1hank HP mt Lee Can01 suppo AaDID nc af for streaming oanem spa apmght UMD Demo Video Chunyuan Liao Nicholas Y. Chen 8 41b Yit Pha Khoo Acknowledgement Paul Dietz Th project in part by NSF Grant IIS-C414.6gg and MKmsoff Cent for Inter tcJn Descjn and Visual 1hank HP mt Lee Can01 suppo AaDID nc af for streaming oanem spa apmght UMD 00:00:09 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Related Work Pen-top feedback Haptic Pen Lee, et al. 04, Poupyrev, 04 Q FLY Pen Leapfrog Computer-coupled feedback Digital Desk Wellner, 93 A-Book Mackay, et al. 02 FLY Pen PaperLink Arai, et al. 97 PaperPoint Signer, 06 Related Work Pen-top feedback Haptic Pen Lee, et al. 04, Poupyrev, 04 Q FLY Pen Leapfrog Computer-coupled feedback Digital Desk Wellner, 93 A-Book Mackay, et al. 02 FLY Pen PaperLink Arai, et al. 97 PaperPoint Signer, 06 00:01:27 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Overview Related Work Case study with PapierCraft Use study Discussion Conclusion Overview Related Work Case study with PapierCraft Use study Discussion Conclusion 00:00:05 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Identifying Key Feedback For Paper Inter Zaces Paper UI Computer UI Three categories of feedback Interface discovery Explore available functions Status Mode, colors, selection Gesture recognition errors Information for specific applications Word search in printout Digital dictionaries on paper Identifying Key Feedback For Paper Inter Zaces Paper UI Computer UI Three categories of feedback Interface discovery Explore available functions Status Mode, colors, selection Gesture recognition errors Information for specific applications Word search in printout Digital dictionaries on paper 00:00:23 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Identifying Key Feedback For Paper Interfaces Paper UI Computer UI Three categories of feedback El Interface discovery Explore available functions mnmnmmmm CFNCNNCNN Status Mode, colors, selection Gesture recognition errors Information for specific applications Word search in printout Digital dictionaries on paper Identifying Key Feedback For Paper Interfaces Paper UI Computer UI Three categories of feedback El Interface discovery Explore available functions mnmnmmmm CFNCNNCNN Status Mode, colors, selection Gesture recognition errors Information for specific applications Word search in printout Digital dictionaries on paper 00:00:13 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Identifying Key Feedback For Paper Interfaces Paper UI Computer UI Three categories of feedback El Interface discovery Explore available functions Status Mode, colors, selection Gesture recognition errors 611FOr Information for specific applications Word search in pnntout Digital dictionaries on paper Identifying Key Feedback For Paper Interfaces Paper UI Computer UI Three categories of feedback El Interface discovery Explore available functions Status Mode, colors, selection Gesture recognition errors 611FOr Information for specific applications Word search in pnntout Digital dictionaries on paper 00:00:08 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Identifying Key Feedback For Paper Interfaces Paper UI Computer UI Three categories of feedback El Interface discovery Explore available functions Status Mode, colors, selection Gesture recognition errors error message Information for specific applications Word seerch in printout Digital dictionaries on paper dmkxj box of searc Identifying Key Feedback For Paper Interfaces Paper UI Computer UI Three categories of feedback El Interface discovery Explore available functions Status Mode, colors, selection Gesture recognition errors error message Information for specific applications Word seerch in printout Digital dictionaries on paper dmkxj box of searc 00:00:11 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Identifying Key Feedback For Paper Interfaces Paper UI Computer UI Three categories of feedback El Interface discovery Explore available functions FIFFFII Status Mode, colors, selection Gesture recognition errors Information for specific applications Word search in printout Digital dictionaries on paper dialog box of search Identifying Key Feedback For Paper Interfaces Paper UI Computer UI Three categories of feedback El Interface discovery Explore available functions FIFFFII Status Mode, colors, selection Gesture recognition errors Information for specific applications Word search in printout Digital dictionaries on paper dialog box of search 00:00:20 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Existing Devices For Xluldple Xl des Modality Property Devices LCDs Portable laser Htgh bandwidth, but bulky and power- consuming Vibration motors, Small, easy to sense, power-efficient Force feedback Powerful but not portable devices Compact hardware, hands-free Earphones, Speakers Compact hardware, hand-free, relativel hi her bandwidth Existing Devices For Xluldple Xl des Modality Property Devices LCDs Portable laser Htgh bandwidth, but bulky and power- consuming Vibration motors, Small, easy to sense, power-efficient Force feedback Powerful but not portable devices Compact hardware, hands-free Earphones, Speakers Compact hardware, hand-free, relativel hi her bandwidth 00:00:21 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Existing Devices For SIulfiple Slodalifies Modality Property Devices Color LEDs Small, low power consumption LCDs Portable laser High bandwidth but bulky and power- consuming Vibration molors, Small. easy to sense, power-efficient fideity Force feedback Powerful but not portable devices Compact hardware, hands-free Earphones, speakers Compact hardware hand-free retativel hi her bandwidth Existing Devices For SIulfiple Slodalifies Modality Property Devices Color LEDs Small, low power consumption LCDs Portable laser High bandwidth but bulky and power- consuming Vibration molors, Small. easy to sense, power-efficient fideity Force feedback Powerful but not portable devices Compact hardware, hands-free Earphones, speakers Compact hardware hand-free retativel hi her bandwidth 00:00:30 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Existh Devices For SIultiple Slodalities Modality Property Devices Color LEDs Small, low power consumption LCDs Portable laser High bandwidth, but bulky and power- consuming Small, easy to sense, power-efficient Force feedback Powerful but not portable fidetty devices Compact hardware, hands-free Earphones, speakers Compact hardware hand-free relativel hi her bandwidth Existh Devices For SIultiple Slodalities Modality Property Devices Color LEDs Small, low power consumption LCDs Portable laser High bandwidth, but bulky and power- consuming Small, easy to sense, power-efficient Force feedback Powerful but not portable fidetty devices Compact hardware, hands-free Earphones, speakers Compact hardware hand-free relativel hi her bandwidth 00:00:17 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Existing Devices For Iultiple lodalities Modality Property Devices Color LEDs Small, low power consumption LCDs Portable laser High bandwidth but bulky and power- consuming Vibration motors, Small, easy to sense, power-efficient Force feedback Powerful but not portable devices Compact hardware, hands-free Earphones, speakers Compact hardware hand-fiee relativel hi her bandwidth Existing Devices For Iultiple lodalities Modality Property Devices Color LEDs Small, low power consumption LCDs Portable laser High bandwidth but bulky and power- consuming Vibration motors, Small, easy to sense, power-efficient Force feedback Powerful but not portable devices Compact hardware, hands-free Earphones, speakers Compact hardware hand-fiee relativel hi her bandwidth 00:00:17 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Existing Devices For XIultiple Xlodalities Modality Property Devices Color LEDs Small, low power consumption LCDs Portable laser High bandwidth, but bulky and power- consuming Vibration motors, Small, easy to sense, power-efficient fiddty Force feedback Powerful but not portable devices Compact hardware, hands-free Earphones, speakers Compact hardware, hand-free, IVolce relatNel hi her banddth I J Existing Devices For XIultiple Xlodalities Modality Property Devices Color LEDs Small, low power consumption LCDs Portable laser High bandwidth, but bulky and power- consuming Vibration motors, Small, easy to sense, power-efficient fiddty Force feedback Powerful but not portable devices Compact hardware, hands-free Earphones, speakers Compact hardware, hand-free, IVolce relatNel hi her banddth I J 00:00:18 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Architecture of the Prototype System via USB cable Simulation I Inkgesture switch Strokes va Bluetc cth Solenoid Auditory feedback feedback Microcontroller via ribbon cable Architecture of the Prototype System via USB cable Simulation I Inkgesture switch Strokes va Bluetc cth Solenoid Auditory feedback feedback Microcontroller via ribbon cable 00:00:15 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Architecture of the Prototype System via USB cable I Inkgesture switch Strokes ia Bluetc cth Solenoid Auditory feedback feedback vm nbbon cable Architecture of the Prototype System via USB cable I Inkgesture switch Strokes ia Bluetc cth Solenoid Auditory feedback feedback vm nbbon cable 00:00:52 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Findings in Pilot User Studies Bad experiences Good experiences Findings in Pilot User Studies Bad experiences Good experiences 00:00:16 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Findings in Pilot User Studies Bad experiences Good experi ences Flashing LEDs for a long time LEDs in solid color Complex color coding Slow change for status indication Findings in Pilot User Studies Bad experiences Good experi ences Flashing LEDs for a long time LEDs in solid color Complex color coding Slow change for status indication 00:00:29 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Findings in Pilot User Studies Bad experiences Good experi ences Flashing LEDs for a long time LEDs in solid color Complex color coding Slow change for status indication Speech for details Lasting and repetitive sounds Auditory Findings in Pilot User Studies Bad experiences Good experi ences Flashing LEDs for a long time LEDs in solid color Complex color coding Slow change for status indication Speech for details Lasting and repetitive sounds Auditory 00:00:19 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Findings in Pilot User Studies Bad experiences Good experiences Flashing LEDs for a long time LEDs in solid color Complex color coding Slow change for status indication Speech for details Lasting and repetitive sounds Auditory Short vibrations for Vibrating for e long time error indication Tactile Findings in Pilot User Studies Bad experiences Good experiences Flashing LEDs for a long time LEDs in solid color Complex color coding Slow change for status indication Speech for details Lasting and repetitive sounds Auditory Short vibrations for Vibrating for e long time error indication Tactile 00:00:13 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Road Xlap Overview Related Work Pen-top Feedback Design Rationale User study Discussion Conclusion Road Xlap Overview Related Work Pen-top Feedback Design Rationale User study Discussion Conclusion 00:00:11 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 A Pen-top Interface for Interactive Paper A Pen-top Interface for Interactive Paper 00:00:15 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Design Goals ofPap erCraft f t Feedback Schemes Easy for novices to learn Maximize performance of both novices and experts Quick, salient but unobtrusive Design Goals ofPap erCraft f t Feedback Schemes Easy for novices to learn Maximize performance of both novices and experts Quick, salient but unobtrusive 00:00:05 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Gesture Level Feedback Scheme for r Novtces Voice for Vibration for ambiguous region LED for final confmmnou LED for cokr Sound for command boundary Key design 121 Delayed feedback Voice for textual information Two-color coding El Vibration for waming Gesture Level Feedback Scheme for r Novtces Voice for Vibration for ambiguous region LED for final confmmnou LED for cokr Sound for command boundary Key design 121 Delayed feedback Voice for textual information Two-color coding El Vibration for waming 00:00:20 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Gesture Level Feedback Scheme for r Nowces Vibration for ambimaous remon LED for final confinmnon W WILD W Ipm, W LED for color 22 Sound for command boundary IN Key design 121 Deleyed feedback Voice for textual information Two-color coding Vibration for waming Gesture Level Feedback Scheme for r Nowces Vibration for ambimaous remon LED for final confinmnon W WILD W Ipm, W LED for color 22 Sound for command boundary IN Key design 121 Deleyed feedback Voice for textual information Two-color coding Vibration for waming 00:00:14 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Gesture Level Feedback Scheme for Experts Voice far Vibration for ambitous region LED for final coou LED for cormmmd color Sound for co d botmdary Key design Minimal feedback for experts final menu confirmation possible vibration warning Gesture Level Feedback Scheme for Experts Voice far Vibration for ambitous region LED for final coou LED for cormmmd color Sound for co d botmdary Key design Minimal feedback for experts final menu confirmation possible vibration warning 00:00:23 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Application Level Feedback Scheme feedback feedback Key design Trade-off between speed and details Slow but able to give information for random access LED Obwous, tntuitive but needs linear scanning Application Level Feedback Scheme feedback feedback Key design Trade-off between speed and details Slow but able to give information for random access LED Obwous, tntuitive but needs linear scanning 00:00:06 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Application Level Feedback Scheme feedback feedback Voice gives the target word s rough position at document-level Key design Trade-off between speed and details Slow but able to give information for random access LED Obvious, intuitive but needs linear scanning Application Level Feedback Scheme feedback feedback Voice gives the target word s rough position at document-level Key design Trade-off between speed and details Slow but able to give information for random access LED Obvious, intuitive but needs linear scanning 00:00:22 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Stunmarv of the Feedback Scheme Design Feedback type Discovary Tagtiik Stunmarv of the Feedback Scheme Design Feedback type Discovary Tagtiik 00:00:04 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Summary of the Feedback Scheme Design Feedback pe Discovery keyword search menu direction Mode. Reeomitiom Plevel search Summary of the Feedback Scheme Design Feedback pe Discovery keyword search menu direction Mode. Reeomitiom Plevel search 00:00:15 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Summary of the Feedback Scheme Design Feedback pe Discover Xpplic ation-s peci.fic menu direction Plevel search Mode. Reccnmitiom Summary of the Feedback Scheme Design Feedback pe Discover Xpplic ation-s peci.fic menu direction Plevel search Mode. Reccnmitiom 00:00:07 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Stunmarv of the Feedback Scheme Design Feedback type X.pplication-s pecfic Pa-level search Markm.z menu direction Mode. Recoition Tagtik B crosslag Commaml Stunmarv of the Feedback Scheme Design Feedback type X.pplication-s pecfic Pa-level search Markm.z menu direction Mode. Recoition Tagtik B crosslag Commaml 00:00:11 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Hypotheses for Validating the System Designs HI The pen helps novice users learn paper interfaces H2 The pen helps experts reduce error with minimal overhead Hypotheses for Validating the System Designs HI The pen helps novice users learn paper interfaces H2 The pen helps experts reduce error with minimal overhead 00:00:17 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 al Task Draw PapierCraft Gestures Stimulus Discovery vs Expert DBD, Auditory channel Multimodal pen papernon-feedback pen, Tablet PC odal pen, al Task Draw PapierCraft Gestures Stimulus Discovery vs Expert DBD, Auditory channel Multimodal pen papernon-feedback pen, Tablet PC odal pen, 00:00:23 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Novice Learning Effect Novice users are able to learn the interface quickly Sufficient training is needed I Multtmodal pen Tablet PC Novice Learning Effect Novice users are able to learn the interface quickly Sufficient training is needed I Multtmodal pen Tablet PC 00:00:25 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Novice Learning Effect Novice users are able to learn the interface quickly Sufficient training is needed A V Simple pencard m w MUltimodal pen A Tablet PC Without oufliers Block ID Novice Learning Effect Novice users are able to learn the interface quickly Sufficient training is needed A V Simple pencard m w MUltimodal pen A Tablet PC Without oufliers Block ID 00:00:08 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Novice Accuracv Tablet PC Multimodai pen, Simple Pen Simple peru-card Multimodal pen Tablet PC Conditions Novice Accuracv Tablet PC Multimodai pen, Simple Pen Simple peru-card Multimodal pen Tablet PC Conditions 00:00:10 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Novice Error Correctton Behavior Simple Pen Multimodal Pen, Tablet PC Simple pencard Multimodal pen Tablet PC Conditions Novice Error Correctton Behavior Simple Pen Multimodal Pen, Tablet PC Simple pencard Multimodal pen Tablet PC Conditions 00:00:11 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Expert Completion Time Tablet PC Simple Pen, Multimodal Pen Multimodal pen got slight speed penalty due to feedback recognition and possible corrections Simple pencard Multimodal pen Tablet PC Condibons Expert Completion Time Tablet PC Simple Pen, Multimodal Pen Multimodal pen got slight speed penalty due to feedback recognition and possible corrections Simple pencard Multimodal pen Tablet PC Condibons 00:00:12 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Accuracy Simple Pen Multimodai Pen, Tablet PC Simple Dencard Multimodal Den Tablet PC Accuracy Simple Pen Multimodai Pen, Tablet PC Simple Dencard Multimodal Den Tablet PC 00:00:18 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Experfiment Result Error Correction Behavior Simple Pen Multimodal Pen, Tablet PC Simple pencard M Litimodal pen Tablet PC Conditions Experfiment Result Error Correction Behavior Simple Pen Multimodal Pen, Tablet PC Simple pencard M Litimodal pen Tablet PC Conditions 00:00:12 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Discussion Future Integrate all hardware into a pen A stand-alone pen-top computer Access an infrastructure like PADD Guimbretiere, 03 Compare the paper-interface with other systems XLibris Schilit, 98 and OneNote Microsoft Support smooth transit between different interfaces Adaptively adjust feedback based on available resources Discussion Future Integrate all hardware into a pen A stand-alone pen-top computer Access an infrastructure like PADD Guimbretiere, 03 Compare the paper-interface with other systems XLibris Schilit, 98 and OneNote Microsoft Support smooth transit between different interfaces Adaptively adjust feedback based on available resources 00:00:49 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Concluston Propose a multimodai pen-top feedback platform A case study of PapierCraft User study proved the effectiveness Plan for a full pen-top implementation with adaptive feedback Concluston Propose a multimodai pen-top feedback platform A case study of PapierCraft User study proved the effectiveness Plan for a full pen-top implementation with adaptive feedback 00:00:25 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Ac knowledgements Sponsors NS F Grant IIS-0414699 Microsoft Research National Institute on Aging intramural research program Hardware and software supporters H P, Lee Company, Anoto and Logitech Thanks Ben Bederson, Bobby Bhattacharjee and Bill Pugh Yit Phang Khoo Paul Dietz MERL Ac knowledgements Sponsors NS F Grant IIS-0414699 Microsoft Research National Institute on Aging intramural research program Hardware and software supporters H P, Lee Company, Anoto and Logitech Thanks Ben Bederson, Bobby Bhattacharjee and Bill Pugh Yit Phang Khoo Paul Dietz MERL 00:00:06 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging Wed, 18 Oct 2006 00:00:00 +0200 A Pen-top Interface for Interactive Paper SCIENCE > 2006 Contact Us Chunyuan Uao liaomaycs, umd.edu Francois Guimbertire francoiscs umd.edu cs umd edu-franco UMD HCIL lab Contact Us Chunyuan Uao liaomaycs, umd.edu Francois Guimbertire francoiscs umd.edu cs umd edu-franco UMD HCIL lab 00:01:59 no Chunyuan Liao, Francois Guimbretiere, Corinna Loeckenhoff, University of Maryland, College Park, National Institute on Aging