Double-side Multi-touch input for mobile devices

Double-side Multi-touch Input for Mobile Devices

Introduction

• Smart phone trends towards larger, higher resolution screens
• Interaction method for manipulation of 3D objects
• Pseudo three dimensional operation ( 'under-table interaction')
• Set of touch gestures for 3D manipulation
• Grab: touching object on both front and backside
• Drag: Grab + sliding both fingers simultaneously
• Push toward/away: touch the object with two fingers on front (away) or back (towards)
• Flip: Grab + sliding in opposite directions
• Stretch: Grab with two or more sets of fingers + sliding

Prototype

• 2 iPod-touch devices back-to-back (5 point touch max per screen)
• Touch input send to the front devices over ad-hoc WiFi
• Future prototypes:
• visual feedback of back positioning
• cursor movement on backside, actions on frontside

Preliminary user study

• 3 users
• Gestures: dragging, flipping, pushing
• Goal:
• estimation of learning curve
• comparison to single side touch
• Results:
• Time to learn double side gestures is comparable to single side gestures
• Execution of double side gestures is comparable to single side gesstures

Related work

• Unimanual and bimanual
• [4] Users benefit from direct-touch input in bimanual tasks
• [5] two-handed multi-touch manipulation is better than one-handed multi-touch in object manipulation tasks, but only when there is clear correspondence between fingers and control points
• Precision pointing using touch input
• [1] ‘Cross-Keys’ and ‘Precision-handle’ as precision pointing
• [3] ‘Dual Finger Selection’ enhances precision of selection
• Back side interaction
• [6] First introduction of back side touch in the Gummi Project
• [9] Under-table interaction: top and bottom touch
• [7] HybridTouch: single touch back side for document scrolling
• [8] LucidTouch: pseudo transparency for back side interaction
• [11] performance of index finger and thumb on front and back side touch

Future work and conclusion

• More extensive user study
• Applying a physics engine to simulate impact of force on object