This is a brilliant video:
Head Tracking for Desktop VR Displays using the WiiRemote
This is the effect I wanted to produce at university back in 1999 for my final year project – but no webcams had any good apis for tracking head movements (I just wanted to track heads, I didn’t think of using the wii).
The trick that Johnny is missing is that he could drop the sensor bar, and adjust the sensitivity to look for redeye reflections from your eyes (which plague all your photos). With a bright IR source on top of the camera, the eyes should be easily findable, and the headgear wouldn’t be needed.
That would give us the headsetless 3D TV we always wanted.