Manipulating reality

For my final Narrative in AR project I decided to play around with the idea of Manipulating Reality.

I formed my project around two main ideas

  1. If with AR tools we are able to "place" in the real world virtual objects and universes, what would happen if we could use haptic controls to manipulate/touch the reality we see
  2. A constant question during this course for me was how to justify the need to hold a screen in front of me in order to get the experience I desire. That is how I ended up thinking that if the haptic controls I was thinking of were attached to a screen then it would be like holding a "magical" looking glass.

So i went back to my previous work regarding tangability and "squishy buttons" which I have been developing further in other classes during this semester. During this exploration I´ve discovered that the tangability of an object that can be squished is highly satisfactory for people.

I decided to use the sensor I´ve been using for said "squishy button" and make an AR experience that would make a yuxtaposition of senses: sound, touch and sight.

For this I used Vuforia as I knew my experience was going to be static, not mobile due to the time I had to develop the piece. So with the vuforia camera I created a grid of reality that could tbe ransformed, for this transformation I thought of the idea of using a reflected image.

The idea of the reflected image came from the exploration of the obiqutous screen, a screen that is in many ways also a mirror - due to its front camera capability-. What if we could touch said mirror and change the way it shows reality back.

So through connecting a sensor that would detect the pressure excerted over a lump of putty in a jar read by an Arduino UNO communicating with Vuforia using Ardunity for Unity, I created an experience that lets you manipulate the reflection of the reality you are in. Then not only Augmenting reality but also augmenting your control of it.

Further developments of this piece will involve making it wireless and portable i.e. being able to move both control and app into a mobile device, probably an iPad.