“3D [Embodied] is a mixed reality performance involving a virtual world as a platform to explore 3D immersive spatial virtual and physical displays. The performer ́s body interacts with the three dimensional space by the input of computer vision, skeleton tracking, and the output of 3D video mapping projection. Both video and audio rendering are generated in real time. Choreography by Yacov Sharir, sound design by Bruce Pennycook and technical support by Yago de Quay. Austin, 2013″
Category Archives: Video
Simon Wheatcroft – &Adapt
I don’t really blog stuff like this; my blog is mostly about Isdaora and technology but I simply had to post this.
It slots in nicely as it shows just how powerful and useful technology can be; not just in the ‘arts’ but for everyday people.
Simon is a good friend of mine (who I don’t see enough of). He is a ultra runner. He is a self-obsessed apple mac fan like myself and a very clever guy. But he is also 90% blind due to a condition called Retinitis Pigmentosa.
Technology is helping in many many ways and if nothing else I just wanted to share this video and show you how cool he is!
You can find out more about him at his website:
Enjoy.
Some of my work [video]
A good friend Dan Shorten from Anomic (Multi-Media Theatre) hired me for various projects in 2012 and January 2013. You can see a trail of these events in my past posts.
Basically I worked in all of the development stages and then worked in the background as a sort of’ technical supervision’ role for all three of the projects in the video. If Isadora had any hick-ups I could jump in and solve and problems; especially in Helsinki were the conditions were so extreme.
This professional video from Polymath films did a fantastic job as they followed Dan and the various projects from start to finish. I was lucky enough to be interviewed at the Heslinki Event at LUX too; you can find my section from 7:10 (but watch it all its well worth it!)
Isadora: using Macros.
A very very quick screencast to show how to use Macros to save space when patching in Isadora.
Isadora Tutorials for Portuguese/Brazilian and Spanish speaking users
Isadora User Stephan Jurgens has set up a Vimeo page for the Portuguese/Brazilian and Spanish.
Head over there and check them out.
https://vimeo.com/channels/511744
and
Future TV?
I have been keeping an eye on a few things lately that I do not normally blog about.
It all started about three weeks ago by randomly finding this video:
As I imagine it did for some of you, it blew me away. What an amazing project.
I then spoke to a friend called Gavin from the Digital Fun Fair who said he had developed something quite similar and we had a good talk about it.
Then I found this on kickstarter…
There are lots of demo’s on YouTube but this seems to be the best i’ve found:
Now this is seriously cool stuff. Plug and play functionality, affordable, multi platform, etc.
Then I found this….
http://www.bbc.co.uk/news/magazine-22315685
This idea has been looming in my head for a while now after I had seen this from Sony;
All this stuff is amazing and right up my street. There are obviously huge technological costs for this kinda stuff, never mind logistics – who has space for projector behind the sofa? Not me.
I can imagine playing an xbox game with practically every wall being projected onto. Combine that with a xbox Kinect and the room would spin and rotate based on your head position… scary! A truly immersive, reactive and spacial aware experience could be created with this technology.
I think this stuff will happen in one way or another.
What are your thoughts?
Z Vector by Delicode.
The guys at Delicode have teased us with a brand new software called Z Vector.
It was code named “The V” for a month or two but now it has a fancy new website and demo video from a band called Phantom and their official music video Scars.
Delicode are the driving force behind NI Mate and Kinect Stories. This third product is sure to blow the socks off any artist, VJ or individual who has the taste for live visuals and kinect style motion sensing trickery. With an already heavy hitting feature list I am sure this will be lots of fun!
I was lucky enough to see a demo of this when I met up with CEO of Delicode Julius Tuomisto in Helisnki for the LUX festival. Being able to single someone out in a crowd and then create visuas from them is awsome; podium dancers will be a brilliant addition to this software let me tell you!
I think people are going to love playing around with the editable GLSL shader editor; I seen it very briefly in january and it was a pop up window that looked a bit like processing.
I need to learn some GLSL coding I imagine. I also like the idea of Syphoning (is that even a word?) the results out into another software to add more layers, mix, map and play around with. Wow… can’t wait.
Features include:
- real-time depth camera based 3D scanning and mixing
- multiple virtual camera and tracking modes
- multiple drawing modes (vectors, polygons, etc.)
- full sound and MIDI clock synchronization
- animatable GLSL shaders with editor
- full support for Windows / Mac OS X
- fully scalable output resolution
- stereo rendering (side-by-side, anaglyphic)
- GPU acceleration
- MIDI/OSC control
- Syphon support (Mac OS X)
Interesting Videos…
A selection of random and interesting videos that I’ve found over the last few weeks….
Code Control Award Winner
Massive well done to Gavin from Digital Fun Fair for this one!
‘holodeck’ IlumiRoom by Microsoft
I knew this would happen one day… More info HERE
Home theatre with modified XBMC running AmbiPi, Raspberry Pi with custom PixelPi showing Avatar fire scene.
I think I am going to have a go at this over the summer; what a cool project!
PixelPusher: Intelligent Networked LED Controller
A nice kickstart project here… I need to look more into this stuff. it even has Syphon input?! Crazy.
LINK: http://www.kickstarter.com/projects/1319139499/pixelpusher?fb_action_ids=10151401673716309&fb_action_types=og.likes&fb_source=aggregation&fb_aggregation_id=288381481237582
http://kck.st/10ECPs8
Isadora & Ableton Live Virtual MIDI [part 2]
This is very similar to my previous video about Isadora and Ableton Live (part 1). But rather than using MIDI notes (triggers) I have used MIDI automation data.
Needless to say you can have multiple clips sending out multiple data feeds. Possibilities are endless really.
The above method is really good for syncing effects with Abelton and Isadora in a VJ or AV performance.
Any questions or comments… post below.
Thanks,
Graham
Projection Mapping in Isadora
This post is to help people understand and get started with Projection Mapping in Isadora. It is not an complete walk through or advanced post (you are best asking on the Isadora forum for advanced topics) but hopefully this will shed some light for new users, or those new to the idea of mapping.
What is mapping?
Mapping has been around for quite some time but my opinion is that it is the art of cutting up images and video to line up with complex shapes that are not the usual method for of display pictures and/or video. It allows artists to project onto buildings, cars, sculptures and custom built sets or similar. Basically anything that a light source (a projector) can hit!
Why Isadora?
Obviously you don’t have to use Isadora but one thing Isadora has that none of the other softwares has in the Interactive angle; motion tracking via Eyes and Eyes++ combined with the easy work flow and ever growing community.
Can Isadora do projection mapping already?
Isadora has had features that have allowed basic to fairly complex mapping for quite some time. It’s just the way in which you use them. Granted; it could be better but with a few 3rd part Quartz plugins 99% of things can be done easily.
Here are some basic actor that you should be taking a look at…
Isadora’s Existing Actors….
BASIC PROJECTOR
*SOMETIMES* the basic projector can be used. In particular look at the perspective, aspect mod and zoom.
HINT: Hold SHIFT when clicking and dragging values for smaller increments and fine tuning!
PRO’s:
- Great for projecting on very basic shapes.
- Helps you understand and learn about perspective and basic 3D perception.
- Ideal for beginners and not too complex.
- You can layer up multiple projectors
CON’s:
- Limited mapping functionality.
- Won’t do complex mapping (isn’t designed for mapping)
3D QUAD DISTORT
I use this one a lot. It’s really great for mapping and has enough features to explore new mapping skills but won’t overpower you with scary numbers or names.
HINT: Hold SHIFT when clicking and dragging values for smaller increments and fine tuning!
PRO’s:
- You can pick each corner of the image/video and move it in an X and Y position.
- The Z translate (default -2.5) moves the image back and forth in 3D (3 dimensional) space.
- You can rotate the X, Y and Z axis.
- Has all the normal features of a the standard Projector actor.
- Not too overpowering. A nice step up from the Projector actor.
CON’s:
- You cant add corners or ‘break’ the image up into a grid.
- It can be tricky at first. Using Shift helps but depending on what you are mapping it can be a bit tedious.
- It can get complicated when you have a lot of these on your screen. You are best renaming the actor so you can see what’s what; such as “Top Right Window” or “DJ Booth – Left Side”.
Matthew Haber’s Mapping Tools.
Some of you knew this was coming! Pro user Mathew Haber has created a bunch of user actors that make mapping a lot easier. Based on the _1024 Quartz Composer
Matthew has created a topic just for support for the plugins on the Isadora Forum so please ask and discuss them HERE
The Cornerpin Mask user actor is in my eyes one of the best tools ever!
“This actors offers click-and-drag cornerpinning functionality for masking video. This has built in facilities for rectangular and oval masks and it also accepts a user Image input for any black and white image mask.”
PRO’s:
- It’s just amazing! it works and makes life easier.
- The red circles that pop up when you turn Edit on allows you to click and drag the corner to where you want them. Not only this you can do it on the stage output… meaning you can map directly onto objects whilst looking at it. So yes, you literally move your mouse onto the output screen. NOTE: Check in isadora Stage preferences that your mouse is visible on stage output otherwise you won’t see it.
- Because this is a Mask; you can mask objects. Send in a black and white mask and it will block out areas you don’t want.
- Easily flick between the type of masks.
- it’s free – kind of…. Needs Core upgrade of Isadora.
CON’s:
- There are non really. Who can complain at this? Mathew has spent hours upon hours putting it together and creating it. If there was one negative it is simply that you need the Core Upgrade for Isadora and you have to instal a few bits and pieces; but once its done its done and you never need to do it again.
Syphon it out to somewhere else…
There are lots of other softwares that just do video mapping. And with apple you can send it out via Syphon to another software that can do it all with very advanced features. There is nothing wrong with doing this. Here are a few suggestions….
MadMapper. It’s been around for a while now and appears on all the main forums when you are talking about mapping. They where one of the first to create an external/stand alone mapping application and its developed along the way. It’s not free but it does a great job.
Visution Mapio is a powerful FreeFrameGL plugin for creating projection shows. Now you can work not only with the standard screen, but also with any inclines, including cylindrical and spherical and various shapes.
Shaped by Ixagon SHAPED is a user-friendly projection mapping software. It enables the user to easily map many different surfaces and attach content to them. The content is managed in a sophisticated sequencer similar to those found in video-editing and music-production software.
MeshWarpServer Quite a complex application. Ideal if you have a mesh/3D CAD designs of a building or object. A steep learning curve but it does have Syphon so you can send media in from isadora. Worth a look for those of you with time, patience and advanced 3D knowledge.
There are LOTS more; VVVV, Resolume Arena, Max, MSP, etc.
Hope this helps some of you.
Graham (Skulpture)
