Eyes ++ (Introduction)


Foreword

The ‘Eyes ++ actor’ what a beauty!

This Isdaora actor is an incredible piece of coding and when you discover what it can do, it takes motion tracking to another level. The ‘Eyes’ actor is great and  is basically a cut down version of the ‘Eyes ++’.

The ‘Eyes’ and ‘Eyes ++’ actors are basically a way of motion tracking objects from the physical world. By watching pixels from a video or more commonly a live feed source, the actors (with a little help sometimes from an effects mixer and a freeze) can track the largest and brightest objects in the frame.

Things to consider.

If you are using a camera at torso/head level then if two or more people walk behind each other – the camera will only see one person (or object). In a way – computers are not clever enough to know that there is a person out of shot and that they will reappear. This can cause problems if a specific person is controlling a specific effect or parameter.

Shadows. A motion tracking nightmare. You can avoid this by using thresholds, blocking out all natural light, or using color tracking instead but unfortunately it can be a little tricky. Experimenting and rehearsing is the only real way to avoid this problem.

Lighting. Closely linked to shadows but basically changing a lighting cue in a performance will alter the live feed video input. Since ‘Eyes’ watches for the largest collection of pixels… a fully blown white wash or spot light can cause problems. Again, rehearsing, planning and foreword thinking solves these issues. Camera Position. Consider locating the camera higher up or mounted safely in the rafters/ceiling if possible. This can solve other lighting and shadow problems but can also produce interesting results in terms of depth and width or (or X&Y or Horizontal & Vertical).

Sometimes, and its only on the odd occasion I have done this…  consider knocking the camera out of focus. You can do this when you do not need the audience to see the actual video input. This can be useful to make a person or object become a little larger, due to the blurred pixels at the edges. This works like a natural edge feather and is sometimes. Something to consider anyway.

The Actor (…and its blobs!)

The Eyes ++ Actor

The Eyes ++ Actor

The image above is the default and untouched Eyes ++ actor. I will not be going into great depth about this actor, just enough to get you going. The next post will show you more and will follow soon.

I always turn on the ‘monitor’ this is located at the bottom of the actor on the left hand side. This shows us exactly what the actor itself is seeing. Turn this on and you should see it spring to life.

What a handsome chap!

I then changed the Objects input. from 16 to 1. Now, if you have read my other tutorials (which you should do! hehe) then you will know all about thresholds etc, so I am going to skip that part and set mine to about 14. Set yours to an appropriate level to get rid of all the background noise.

You should now get some ‘basic’ data…. but you can’t see anything coming out of the output of the actor, what the hell are all these blobs?! Well calm down and let me explain.

The Blobs

I guess this is the fundamental part. The 16 blobs on the right hand side of the actor relate to the 16 maximum objects that one Eyes++ actor can watch/track. Since this actor would be huge to show all the information for all 16  possible objects a separate individual actor is used. And this is how…

Makes sense? Obviously you can add all 16 if needed but for now I am going to leave it as just one.

Similar to the ‘Eyes’ actor you get a lot of data, horizontal and vertical values, Objects full Height and Width, Velocity (or speed) of the object and a few others.

You can smooth the values out with the ‘smoothing’ input on the Eyes++ actor.

Have a play around with the ‘bounds track’ and ‘median fit’ to explore what they do and don’t forget that you can alt  click on the white text and go to ‘Actor input Help’ to read more about the options. For example, the lifespan option:

Extra Help is always only a click away!

I hope this post helps all you interactive wizards! Get playing around and see what you can come up with!

Enjoy,

Skulpture

Advertisements

4 thoughts on “Eyes ++ (Introduction)

  1. I’ve been trying to motion track with multiple Blobs in Eyes++ but can not see how to get other Blobs working. I can achieve one tracking Blob as you have done above. Any info you could give me with regards to this I be very appreciative. There’s not a lot of info on this on the web. I’ve bee hunting this down for a while.

    Cheers
    Stu

    • Hi Stuart,

      I will do a tutorial sometime soon. I have a few to do actually over the next week or so. I basically add more than one blob decoder and then fine tune to settings. it all depends on what you are trying to achieve.

  2. Thanks for getting back to me. I will look out for it. I have only just got the software so at the moment I’m just having a bit of a play. Ultimately I am interested in using live tracking and projection with theatre performance. I’m now experimenting with the best / cost effective ways of tracking objects, shapes, forms etc. I work at a University and have access to other ways of motion tracking, but obviously tracking in this manner will be quicker to set up and have less equipment to calibrate.

    When it comes to Eyes++ I’ve tried connecting multiple Blob decoders but this has not added any tracking points. The out put from a blob and the blob decoder remains static and uneffected by any of the motion caught on camera. It also seems a bit random as to what it will track. I know it works with the luminance of the pixels but can you predetermine the subject you want it to try and track?

    IMO the documentation with Isadora is pretty limited. Ever thought of a publication of you tutorials other than online?

    Thanks Again
    Stuart

  3. Pingback: 2010 in review « VJ Skulpture's Blog

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s