Isadora + Processing + Kinect


Makey Makey GO


So I bought a Makey Makey GO! I backed it on kick starter.

It’s petty cool. But I still prefer the classic.

However I did make a silly little thing in the office:

I attached it to my can of pop so every time I picked it up it clicked a video and opened it in Preview on Mac. I made me laugh. I really like not having to have an ‘earth’ unlike the Classic – but there are ways around that anyway.

Check it out:

http://www.makeymakey.com/

Isadora Art Gallery Interactive.


I have been working on a nice little project at work. I’d rather not say too much about it just yet as it’s a bit of a secret.

But it’s basically a push button interactive that will use a webcam and Isadora. Its stand alone and fully automated. Here is a glimpse of it from the back – if you are a techy like me then you always like to see the ‘guts’ of the piece.

A 32″ samsung LED TV has been used. A standard 2015 mac mini, a HD Logitec webcam, the amazing Makey Makey original board with a commercial grade push button. All houses in a custom made frame.

I will take some more pictures and probably some video once the project is complete.

Here are a few images!
15807_10152844730666082_4831080861529580716_n 11698692_10152844730696082_364900280931301757_n 11707560_10152844730651082_5700449843051598593_n

Leap Motion


I like my gadgets. I am admittedly a bit of a gadget freak… but I don’t often actually buy them. Normally because they are expensive and I know deep down I won’t use them as much as my mind believes I will. But the Leap Motion is different.

The Leap Motion is a USB powered hand/finger tracking device. Think of it as an xbox kinect for the hands perhaps? It’s made for Mac and Windows too which is great.

The into video explains the basics very well…

I have bought one (second hand off eBay for £40 I might add) to use at work and at home. I have a few ideas for it and if nothing else will be a handy (pun-intended) gadget on my office desk – it’s already plugged in actually. It’s small sleak and sits flush to my MacBook Pro. It’s a shame it’s not wireless as it takes up a USB plug but I have a powered hub on my desk.

How am I going to use it? To be honest I have no concrete ideas. There are a few Isadora users who have made a few OSC/MIDI related actors to control Isadora scenes which I am going to look at and I am sure I can find a few uses in that area. I also like the idea of using it for generate/live painting in a VJ context. Will I look an idiot waving my hand around at a gig to make stuff appear on the screen? – probably! Do I care?…. probably! But we shall see.

I also want to see if it can be used in a commercial sense. At the museum and art gallery where I work we have interactives for visitors but people, for some reason, LOVE to hack, break, pull, snap, spill drinks, etc, etc on keyboards, mouses, touch screens, etc. Now this can’t be helped all the time of course, but there is a tiny percentage who do it on purpose, I’ve seen them! Maybe a Leap Motion placed under some perspex (military grade?) could replace the keyboard and mouse idea? Problem is the learning curve! How will people know how to move their hands or even to put their hands above the device? Similar to the Kinect sensor it’s not a recognised Human Input Device (HID)

So – I will keep you posted. Minority report… Yeah! Let’s do it!

Do you own one? Let me know how you are using it. I wanna know… Let’s talk!

Barbican Video Mapping (Isadora Mapping)


I managed to get some footage of a project I was helping with a few weeks back.

This was held at the Barbican Theatre/Performance Venue in London, UK. My friend Dan Shorten (from Anomic) who works as Guild Hall School of Drama had students help out and we helped the Barbican promote the spaces and areas they have for potential clients.

I helped with some of the mapping and made sure Isadora ran smoothly. Which it did… of course!

World Stage Design 2013 ‘Isadora and Interactivity’


World Stage Design 2013 ‘Isadora and Interactivity’ workshop.

I am pleased to announce that I will be doing a workshop at World Stage Design 2013 in the UK, Cardiff, Wales on Friday 13th September.

This one day course will cover key areas of the Isadora software. And its use as an interactive tool. The workshop will cover many topics that are relevant to a wide range of disciplines including dance, theatre, VJ/DJ and technician/installation.

Delegates will have the opportunity to gain an insight including real-life tips and tricks, from one of the UK’s top Isadora experts (me!).

Who should attend?

Professionals and students within all areas of theatre design

Price: £12

More info here: http://www.wsd2013.com/whats-on/isadora-and-interactivity/

‘Reveal’ Report Part.1 [LUX – Helsinki]


Approximately a year ago a good friend of mine Dan Shorten (Anomic) rang me up with an offer I couldn’t refuse….

He needed a bit of a hand with some technical guidance for a project called Reveal which would be shown at LUX, Helsinki in January 2013. So after many trips to London over the last year we developed, tested and created an Isadora patch and I happy report that it all went well.

I have had quite a few people ask me how it worked, technical details and the hardware used. I decided before I went that I’d write a report when I got back so below is as much detail as I can give…

THE CONCEPT

The concept was obviously driven by Dan as the artist. He had the ideas but the odd effect was influenced from me. Dan has some great ideas and nothing is too crazy! I love having a beer with Dan as I can often see him thinking of an idea and I just sit waiting for him to ask me of its possible, then between us we try and make it a reality. This was the case for Reveal.

The concept was started by finding out that Lux had given Dan a huge section of wall to project onto. This is no normal wall, it’s the side wall of a location callee the Baana which is a little tricky to describe, it’s like a mini valley running through the city which used to be a railway line. It had been converted to a walkway and cycle path last year for the locals to get quickly to and from the centre of town.

The image below shows this a little better.

The Banna by day.

We had limited knowledge as to how busy this area would be, obviously not living in Finland we didn’t know the area, the people or the conditions. We also didn’t know how active the people would be. Anyone who has worked with the public will know; people are unpredictable. Would people stop and interact and engage?

Another slight issue was the weather. Saying ‘it was cold’ just doesn’t cut it! It was so cold it hurt… But the local production crew and security firm assured us that it was a ‘good week’ and the week before had it dropped to -25 with the wind chill. This was as cold as the North Pole apparently. I will discuss problem and issues in more depth my next post.

The concept and focus of Reveal was to allow people to reveal parts of the wall and engage them in a variety of different ways. We wanted it to be somewhat random, bright and changing every 10/15 minutes. We didn’t want it to be a self contained and automated system either. We wanted it to be as interactive as possible but we could change the images/video whenever we wanted in response the the audience.

As Dan states on his website;

“…’Reveal’ is an interactive and participatory video installation in which the public can influence their surroundings by “revealing” the hidden possibilities in everyday spaces. Specially composed music and the sounds help create a fascinating new environment”

So we decided for 70% of the scenes in Isadora to use layers. When no one was in the space, or if no one was moving then we would project a near exact digital replica of the wall. It was just like a digital mask. Then the people moving, or the cyclists flying by made the reveal part by becoming active or human masks; moving the digital wall out of the way to see what is underneath. The human/live camera feeds worked as the mask, this raw video feed combined with short video delays, motion blurs and lots of other isadora configurations this made the reveal much more interesting. Image shows this below:

A screen shot of Reveal and the masking idea

Using the Eyes actor in Isadora (which I have a few tutorials on inside this blog!) we used simple but effective calculations, curvatures and scaling to ramp up music samples and background loops. So the louder the music became the more people moved and danced, etc.

This Baana is a new area for Helsinki and the people there where only just starting to use it. It was popular for cyclists though and we had to take that into consideration. As it was unlikely the people on bikes would stop and interact; yet we wanted them to be involved – even if they didn’t know it! So the reveal part of this worked really well because as cyclists went whizzing by the people watching got to see a really cool effect, this then spurred them on to get interactive with the space themselves.

HARDWARE

We used an Apple Mac Pro Tower, which was amazingly specked out!

  • Mac Pro tower 2x 3.06GHz 6 core Intel Xeon
  • 64gig of RAM
  • 1 x TB 7200 drive
  • 3 x 512 SDD drives
  • Mountain Lion OS
  • DataPath x4 DVI graphics expansion module
  • 3 x Panasonic PT EX16KE XGA (1024 x 768) LCD projectors
  • DVI splitters to feed 3 x preview monitors
  • Lots of cables and power.
  • Coffee Machine!

SOFTWARE

Software was just Isadora running version 1.3.0f25. No additional tracking software or fancy quartz plug-ins. Isadora programming at its best!

Isadora had about 20-25 scenes all doing different things, some quite subtly different than others, some very unique. In some patches we used all three live feed cameras and in others just one (generally the middle camera). Again; this was just to mix things up. We had one crash and that was only because we where editing effects live and we messed something up. So its safe to stay isadora worked amazingly.

PRE-PRODUCTION

Dan took a hi-res photo of the wall during his first visit and stitched it together to give us something to work from in terms of scale and general planning. This helped a lot.

In London Dan started work on content for the piece. I seen a few edits whilst I was down there and they looked brilliant. All of the work was done in After Effects and Cinema 4D (which Dan is geting far to good at using!) My only input was general generation of ideas and introducing him to the 3D Element plug in from Andrew Kramer.

We had a few smaller projects on the go which helped us prepare and work out the video mapping side of things which was great. Dan also flew Isadora creator Mark Coniglio over to the UK to run a few ideas past him, ask about hardware set up and generally ask as much as we could whilst he was there. Mark always amazes me at how hard he works and he had some great ideas too.

All video and image files where 2600*600 quicktime running the ProRes codec.

We though we would have to use software edge blending but luckily the projectors had that feature built in so it was less work for the machine. And being a flat wall (well flat-ish) we didn’t require really advanced soft edge blending/warping.

A screen shot of the live CCTV cameras in InfraRed mode.

A screen shot of the live CCTV cameras in InfraRed mode.

Thank you to this person who filmed a bit…. (I have more videos on the way)

// So thats the end of part one…. I will post the next section in the next few days.

Skulpture