Onboarding process for the Interface - Interaction Design
Project Goal

Create a natural user interface for 3D modeling using Hand Gestures.

Interaction Design

· Left mouse button click - Specify 3D points or specify action events
· Right mouse button click - Rotate the camera
· Right mouse button click & first two fingers together - Pan and Zoom
· Forefinger and Thumb pinch - Freeze the 3D pointer to reposition your hand to cover more 3D space

Prototype 1
Prototype 2

Recently I was looking through my old projects and I came across this one and suddenly a dozen ideas popped around in my head. So I buckled up and one night later, had a significantly better prototype.
GUI · Cylinder, Polygon Extrusion, 3D Sketching, Fill
GUI · 3D Sketching mode
GUI · Cylinder Mode
3D objects (cylinder) using Left mouse click to specify origin, radius and height of the cylinder
3D Sketching using Left Click to specify points and Right Click to rotate the camera· 
Next Steps

I realized that I can only go so far with ProcessingOrg since it was difficult to do multiple render passes, Leap Motion did not have a hand model that I could render in the scene. So I have decided to port this whole project to Unity.

Two icons in the GUI were downloaded from the Noun project
1. Hexagonal Prism by Sam Martin from the Noun Project
2. Cylinder by Sam Martin from the Noun Project

You may also like

BounceMR · Mixed Reality Game between multiple worlds
MockupVR · Build VR designs in Virtual Reality
Instabland · Your boring life, no filters
Ticket360 · 360 degree photos to improve Ticket sales
LearnMR · Learn ASL using Hololens Mixed Reality
TalkRecipe · Conversational User Interface for recipes
GhostbustersVR · Natural User Interface for VR
Berlin Wall VR · Virtual Reality Experiment in Empathy
Back to Top