I’ve just converted a dual camera video into a wiggle stereograph video. This is just a test with a fixed distance between the images. There are points where the subject object is closer, and the 3D effect could be improved by hand-aligning the twin frames. Overall it seems to work quite well though. Certainly possibility for an effective 3D visualization.
What do you think? Can you get a sense of the depth in the video, or does it give you a headache?
The video above shows the work of artist Pablo Valbuena; working with projective augmentation of space:
This project is focused on the temporary quality of space, investigating space-time not only as a three dimensional environment, but as space in transformation.
For this purpose two layers are produced that explore different aspects of the space-time reality. On the one hand the physical layer, which controls the real space and shapes the volumetric base that serves as support for the next level. The second level is a virtual projected layer that allows controlling the transformation and sequentiality of space-time.
The blending of both levels gives the impression of physical geometry suitable of being transformed. The orverlapping (sic) produces a three-dimensional space augmented by a transformable layer suitable to be controlled, resulting in the capacity through the installation of altering multiple dimensions of space-time.
The overall effect is to give a fantastic sense of the dynamism of volume. Mapping the physical space in this way invites one – or me at least – to explore the possibilities of that space.
I’ve been inspired to experiment (using my Augmented Reality resources) with abstracting real buildings into their volumetric footprints; removing the fascias, the textural materiality, and leaving just the space. God knows there’s a movement towards “digital buildings”, with projected faces – it should be interesting to turn the tables and privilege the walls themselves, and then perhaps begin to bring the possibility of projections and materiality back in.
On a technical note, the object-size to marker-size ratio necessary for these volume projections makes the Augmented Reality marker alignment very sensitive to error. Effectively the far edges of the object act like the needle of a gauge amplifying motion, and it’s very easy to notice when they are out of “whack”. I’ll have to tweak the matching code, or capture using a bigger marker, before I can upload some video. Alternatively, I could use edge-detection from the initial stage of markerless AR to detect the wire-frame structures outright.
I have finally got animated VRML working, but somewhere along the line the JPEG library broke, so textures will have to wait. so I’m using a lower-quality GIF texture. Just a few more tweaks of the processing code, and I’ll feel happy to switch to the modelling and “sculptural installation” work.
The static model is a scan of myself I did a few years ago using a home-built 3D scanner. I’ve skinned it onto a skeleton and applied one of the motion-capture gestures from Max Payne 2.
Apologies for very repetitive subject of posts lately – I’ve been focussed quite strongly on this project. What you think do far? Do you have any thoughts of how to use the technology to engage with architecture? I’d love to read your comments!
This weekend I have spent many hours getting up to speed with C programming, and trying to compile library dependencies for ARToolkit. Until now, the ARToolkit was only useful for real-time processing of video using a webcam. The result the weekend’s work is that I can now load image sequences (that have been exported from video), process them, and spit them out the other end with the augmented reality overlay. I’ll be able to go out into the field and start creating architectural interventions.
So far I have only applied this to the simple box code, but I will look at the VRML tomorrow.
Okay, so this has been a long time coming, but it’s hard not to admit that it is very cool. I’ve plugged a low-polygon VRML-based version of myself made years ago using my 3D scanner, into the Augmented Reality toolkit.
Here is the model taken from on screen:
I will be working on getting pre-recorded video parsed into ARToolkit, so I can process video taken on a mobile phone.