Archive for May, 2009

Get some Photoshop Actions for Interesting Video effects

Saturday, May 23rd, 2009

I’ve recently been trying to explain to people what I’d like to do with architecture and augmented reality, and getting blank looks – i.e. failing. Most succinctly, I want to mess with existing architecture by virtually intervening with it, using a technology called Augmented Reality. Augmented Reality is

a field of computer research which deals with the combination of real-world and computer-generated data (virtual reality), where computer graphics objects are blended into real footage in real time.

and is fantastic, because when the software is running on a mobile phone, it allows the viewer to walk around the installation and get a more spacial feel for it and its context.

Explaining ideas is always a really good way to explore/discover/flesh-out the idea in your own mind. Hence I’m thinking of either making a comic-style illustrated description, or a 3D animated one. Either medium will give me plenty of opportunity to think about the spaciality of different interventions.

I’ve created a few Adobe Photoshop CS2 Actions, to experiment with how different grey-scale filters will look on 3D rendered video content. Here are the video tests, and you can download a .ZIP of the four actions applied (the Actions should work with CS2 or above). I’d be happy to provide a video tutorial of how to convert video to image-sequence, apply actions, and put the image back into video, if anyone needs it?

 

 

Animated VRML overlay

Tuesday, May 19th, 2009

I have finally got animated VRML working, but somewhere along the line the JPEG library broke, so textures will have to wait. so I’m using a lower-quality GIF texture. Just a few more tweaks of the processing code, and I’ll feel happy to switch to the modelling and “sculptural installation” work.

The static model is a scan of myself I did a few years ago using a home-built 3D scanner. I’ve skinned it onto a skeleton and applied one of the motion-capture gestures from Max Payne 2.

Apologies for very repetitive subject of posts lately – I’ve been focussed quite strongly on this project. What you think do far? Do you have any thoughts of how to use the technology to engage with architecture? I’d love to read your comments!

Offline AR processing

Monday, May 18th, 2009

This weekend I have spent many hours getting up to speed with C programming, and trying to compile library dependencies for ARToolkit. Until now, the ARToolkit was only useful for real-time processing of video using a webcam. The result the weekend’s work is that I can now load image sequences (that have been exported from video), process them, and spit them out the other end with the augmented reality overlay. I’ll be able to go out into the field and start creating architectural interventions.

So far I have only applied this to the simple box code, but I will look at the VRML tomorrow.

littleBits

Saturday, May 16th, 2009

From We Make Money Not Art blog:

littleBits intro from ayah bdeir on Vimeo.

littleBits is a growing library of preassembled circuit boards, made easy by tiny magnets. All logic and circuitry is pre-engineered, so you can play with electronics without knowing electronics. Tiny magnets act as connectors and enforce polarity, so you can’t put things in the wrong way. And all the schematics will be shared under an opensource license so you can download, upload, suggest new bits and hopefully see them come to life.

Very cool and fun.

3D Scan in Augmented Reality

Friday, May 15th, 2009

Okay, so this has been a long time coming, but it’s hard not to admit that it is very cool. I’ve plugged a low-polygon VRML-based version of myself made years ago using my 3D scanner, into the Augmented Reality toolkit.

Here is the model taken from on screen:
 

 
I will be working on getting pre-recorded video parsed into ARToolkit, so I can process video taken on a mobile phone.