This is another reason it sucks I wasn't born later. This is the sort of thing I've dreamed of, being able to manipulate a computer with something that makes sense, a way to directly manipulate things like a 3D mesh, in real time. I've dreamed of a 3D mouse that was sort of a blob with knobs poking out to represent X, Y, and Z axis, both positive and negative. To stretch the mesh, you'd grab the knob at the top and pull it upward, which would cause the mesh to deform. Make it wider by pulling on both the left and right horizontal knobs. This is nothing short of magic, it really is, it's a dream come true.
Jeff Han is a research scientist for New York University's Media Research Lab. Here, he demonstrates—for the first time publicly—his intuitive, "interface-free," touch-driven computer screen, which can be manipulated intuitively with the fingertips, and responds to varying levels of pressure. (Recorded February 2006 in Monterey, CA. Duration: 09:32)
Link