Isadora + Processing + Kinect


Isadora Art Gallery Interactive.


I have been working on a nice little project at work. I’d rather not say too much about it just yet as it’s a bit of a secret.

But it’s basically a push button interactive that will use a webcam and Isadora. Its stand alone and fully automated. Here is a glimpse of it from the back – if you are a techy like me then you always like to see the ‘guts’ of the piece.

A 32″ samsung LED TV has been used. A standard 2015 mac mini, a HD Logitec webcam, the amazing Makey Makey original board with a commercial grade push button. All houses in a custom made frame.

I will take some more pictures and probably some video once the project is complete.

Here are a few images!
15807_10152844730666082_4831080861529580716_n 11698692_10152844730696082_364900280931301757_n 11707560_10152844730651082_5700449843051598593_n

What the bloody hell is OSC? (Open Sound Control)


OSC – Open Sound Control.

What the hell is this I hear you cry? OSC is becoming used more and more. VJ’s DJ’s and AV interactive peoples (and everything in between!) are starting to use it. It’s not very clear what it is and how it all works. I found it complicated when I first discovered it. So, this is NOT a how to get OSC working with software A or B just a general overview of what it is and how it works – hopefully in a friendly delivery.

Screen Shot 2015-05-28 at 09.49.28

OSC BASICS.

In it’s simplest form, is a protocol which sends numbers from one location to another.

OSC uses an IP address (Internet Protocol address) which means it has to know the address of the computer it is sending to. So, You can think of an IP address as a street name.

So let’s take a theoretical IP address:

90.44.129.91

We can think of 90.44.129.91 as a street name such as “Victoria Lane”. But Victoria Lane could have thousands of houses on it or a big block of flats, etc. So we need a house number.

After an IP address you generally have a port. A common one is:

9001

Therefore now the address is 90.44.129.91:9001 (note the : its not a . after the 91)

So now we have Victoria Lane, house number 9001.

But perhaps you want to know what room in the house you need? In OSC this is called a channel. Channels range from 1-999

So lets say we want OSC channel 4. Now our address is: Victoria Lane, house number 9001, room 4. Or in OSC talk 90.44.129.91:9001 channel 4.

However…

Computer’s change the IP address every time they start a new network, shut down and re-open, etc. This is a way of safe guarding your machine from attacks and hacks.

How do you find your IP address?

Google: “how to find your mac IP address” it will show you at the top. This is the same for Mac and Windows.

Screen Shot 2015-05-28 at 09.26.10

Static IP
You can however create a static IP address. This is fixed and will never change.

Static IP is generally better for performances as the numbers never change and you are in control. Downside is when you create a static IP you can not connect to the Internet like normal. You are basically creating a Local Area Network. (there are ways but I don’t want to complicate things).

How do you create a static IP?

http://www.macinstruct.com/node/550

Localhost

This can be confusing. Local host is always 99% of the time 127.0.0.1 think of this as a home/default IP.

It’s almost like a feedback loop. It’s hard to explain but you can find out more here:

http://www.tech-faq.com/127-0-0-1.html

In’s and Out’s.

The ‘house number’ that we chose earlier is an IN; we chose 9001. But if we want data to be sent back we need and OUT and we can’t go IN an OUT door. They have to be different.

So the OUT port would need to be a number close to 9001. Maybe 9002 or 9005 (anything really).

WHY DO WE NEED AND IN AND OUT?

Say we press a button a TouchOSC app on your iPad. The signal is as follows:

Press button: sends value OUT to 90.44.129.91:9001 on channel 4. Software receives this Value and ch 4 is mapped to a button : the button turns on an effect.

Most apps like OSC will automatically light up and change depending on if the toggle is momentary or toggle.

But if you changed the button on the software using your mouse or QWERTY keyboard you want the iPad app to update so it says in sync. So you can tell 90.44.129.91:9001 on channel 4 to send a message ‘light on’ (or change state – basically replicate a button press)…. but it has to be on a different port.

This is often the case with VJ/DJ’s who have multiple controllers and wanting all the hardware and software to change and keep updated. Such as Touch OSC.

Packets and Strings.

OSC can send either a long string of numbers constantly. Like water pouring down a stream. It has no start and stop and everything travels in one long line.

OSC packets are small chunks of data bundled up in packets/parcels. This is like collecting water from a pond up stream in a big glass, carrying it downstream and then pouring it back out. [excuse the really random story telling – I don’t know where I get these ideas from! lol].

This is only a very simple explanation and the advanced users reading this will be laughing but in a VERY basic format this is all you need to know for now.

Summary.

Without confusing you, or incase you don’t know it OSC is similar to MIDI/DMX. The values range from 0.0-1.0 and send the data very quickly over WIFI or down cables.

You can read more here:

https://www.wikiwand.com/en/Open_Sound_Control 

http://opensoundcontrol.org/introduction-osc 

http://troikatronix.com/support/kb/using-touchosc-with-isadora/

I hope this helps some of you.

Thanks,

skulpture 

Don’t let Apple kill Open Ni


http://petitions.moveon.org/sign/apple-let-apple-kill

Written by Mark Coniglio:

Artists, designers, makers, and tinkerers around the world have leveraged the power of 3D cameras like the XBox Kinect and XTion Live to create innumerable interactive installations, performances and other compelling works of art. The OpenNI SDK is a key technology behind many commercial and open-source software programs that have empowered this artistic expression. So, we were surprised and shocked when we saw the notification on the OpenNI site that said the web site would close on April 23rd.

Apple, you bought Prime Sense, and now you want to kill this critically important technology. We’re respectfully asking you: don’t do it.

Many of us in this community remember a time when Apple was our champion. You provided us with a truly innovative operating system that offered unforeseen ways to interactively control and present media. This in turn led to the development of of thousands of applications that empowered tens of thousands of artists to inspire and entertain audiences around the globe. (And, by the way, help you sell millions of computers.)

Mr. Cook, your action to take away OpenNI runs counter to that history. We know your priorities have changed. We know that it’s all about mobile devices these days. We understand that you likely have your own plans for 3D imagining technology.

But, empowering personal expression through technology was one of the core values that made Apple the great company it is. We are asking you to remember that part of your history today, and to support us by changing course. Keep OpenNI open and available to us.

PLEASE SIGN THE PETITION! WE NEED THIS TO STAY!

http://petitions.moveon.org/sign/apple-let-apple-kill

World Stage Design; Free Patch



If you came to my World Stage Design talk in Cardiff a few weeks ago then you will recall me offering to share the demo patch I used on the day….

Well here it is. This is just a template. I highly suggest you watch Mark Coniglio’s tutorials here to refresh your memory.

I have added the ‘tracker.mov’ video which replicates a person for motion tracking.

[DOWNLOAD HERE] It’s in a .zip file and is 618kbs.

You can download the demo of Isadora here for free:

http://troikatronix.com/download/isadora-download/

Leap Motion


I like my gadgets. I am admittedly a bit of a gadget freak… but I don’t often actually buy them. Normally because they are expensive and I know deep down I won’t use them as much as my mind believes I will. But the Leap Motion is different.

The Leap Motion is a USB powered hand/finger tracking device. Think of it as an xbox kinect for the hands perhaps? It’s made for Mac and Windows too which is great.

The into video explains the basics very well…

I have bought one (second hand off eBay for £40 I might add) to use at work and at home. I have a few ideas for it and if nothing else will be a handy (pun-intended) gadget on my office desk – it’s already plugged in actually. It’s small sleak and sits flush to my MacBook Pro. It’s a shame it’s not wireless as it takes up a USB plug but I have a powered hub on my desk.

How am I going to use it? To be honest I have no concrete ideas. There are a few Isadora users who have made a few OSC/MIDI related actors to control Isadora scenes which I am going to look at and I am sure I can find a few uses in that area. I also like the idea of using it for generate/live painting in a VJ context. Will I look an idiot waving my hand around at a gig to make stuff appear on the screen? – probably! Do I care?…. probably! But we shall see.

I also want to see if it can be used in a commercial sense. At the museum and art gallery where I work we have interactives for visitors but people, for some reason, LOVE to hack, break, pull, snap, spill drinks, etc, etc on keyboards, mouses, touch screens, etc. Now this can’t be helped all the time of course, but there is a tiny percentage who do it on purpose, I’ve seen them! Maybe a Leap Motion placed under some perspex (military grade?) could replace the keyboard and mouse idea? Problem is the learning curve! How will people know how to move their hands or even to put their hands above the device? Similar to the Kinect sensor it’s not a recognised Human Input Device (HID)

So – I will keep you posted. Minority report… Yeah! Let’s do it!

Do you own one? Let me know how you are using it. I wanna know… Let’s talk!