Virtual Viewpoint Demo Download (Updated 2008-03-01-23:10)

by Derek

You can now download an executable version of the Virtual Viewpoint code. Warning: this is a draft of an experimental program and there are many problems that still need to be worked on. Updated: A new version of the executable that fixes the display resolution problem is now available. The link at the bottom of this post has been updated to point to virtualviewpoint_002.zip. Please tell us if this works for you.

What you'll need:

  • Webcam (must be automatically recognized by Windows)
  • Windows XP (Sorry, we've only tested on Windows XP.)
  • Executable and associated files. See download instructions in the next section.
  • You will need to have Version 2.0 (2.0.50727.42) of the Microsoft .NET framework runtime installed. Microsoft .NET Download

Download:

  • Download, save to a directory, and unzip. Download link at bottom of post.
  • VirtualViewpoint.exe - executable. Click on this to run.
  • bubbles.png - picture of the bubbles.
  • background.png - background picture. You can substitute your own .png picture by naming it background.png.
  • config.dat - configures screens. You can edit this file if you are adventurous. The default is for a 15 inch wide screen.

Operation and Controls:

  • Place the webcam above the screen and connect to your computer.
  • For best results, the camera should see a plain background and the space should be well-lit.
  • Sit back about a meter from the camera and screen.
  • Execute the program VirtualViewpoint.exe. (Webcam must already be connected.)
  • Press "S" to start the eye tracking.
  • Now shift your head position and watch the screen change accordingly. Be careful not to go outside the view of the webcam, which is typically fairly narrow.
  • If the algorithm loses track of your eyes, press "S" again to reset the eye tracking.
  • To increase reality of the 3-D virtual viewpoint experience, try closing one eye. Be careful not to cover your eye with anything as it will fool the eye-tracking.
  • You might try pressing "SPACE" when your head is centered to recalibrate.
  • Press "ESC" to exit the program
  • Have fun, and give us your feedback.

Download Virtual Viewpoint Demo Here

30 comments

Comment from: Chris Sheridan [Visitor]
Very very cool concept. It doesn't work on my computer however, but that's OK!
02/28/08 @ 04:05
Comment from: Hihat [Visitor]
Sorry, it doesn't even start on my computer:
Intel Core 2 duo, win xp, radeon hd 3650.
Looks exciting though. Good luck with it.
02/28/08 @ 05:45
Comment from: Graham [Visitor] Email · http://www.fontgod.com
Im getting a "Could not initialise direct 3d" error on attempting to start the Virtual Viewpoint demo.

Ive just checked and seems Im running the latest version according to MS update.

Anyone else getting this problem?

DXdiag is reporting no problems. Im keen to see this tech as Ive been testing out several headtracking techs recently.
02/28/08 @ 05:45
Comment from: Martian [Visitor]
Doesn't work for me. Intel Core 2 duo, win xp too.
Maybe with an installer?
02/28/08 @ 10:02
Comment from: Derek [Member]
Sorry about the program not working for some of you and we'll try to track the problems down. If you had success getting it to work, we'd like to hear from you as well. This will also help us track down why it doesn't work for some people.
Thanks.
02/28/08 @ 11:45
Comment from: Gary [Visitor]
Looks interesting, but unfortunately it doesn`t run on my pc either...dx failed to initialise.

Core 2 duo XP SP2
02/29/08 @ 10:52
Comment from: Derek [Member]
I forgot to write that you will need to install the Microsoft .NET run time. I've modified the post above with the link to the needed download. Hope it works now.
03/01/08 @ 00:44
Comment from: Derek [Member]
I have created an updated version of the software virtualviewpoint_002.zip that fixes a problem that we found with a hard coded display resolution. It now automatically uses the your current display resolution. I've tested it with a couple of other monitors and it seems to work OK. Make sure you connect your webcam and you have the drivers installed before you start the VirtualViewpoint.exe program. Please tell us if this works for you now and thanks for your interest.
03/01/08 @ 23:29
Comment from: rob [Visitor] Email · http://www.headtracking.nl
hello guys,

I really like the experiment, you guys doing a great job. I tested it on a couple of computers, but the only thing i get is a grey screen, no error just a grey screen, and nothing happand. I downloaded the latest update from microsoft, and i'm working on a laptop with dual procesor, 128 mb graphic card, so i don's think it's the hardware.

Of course the program is on a verry first stage, so it's pretty normal that things happen like this, i hope you guys working on updates.

Good luck,

Rob ---> www.headtracking.nl
03/02/08 @ 02:35
Comment from: trungvo [Member] Email
Hi Rob,
If you're getting a grey screen that means the program started successfully. What you need to do now is press "s" to start the eye tracking. The 3D viewpoint should also start after you press "s".

Thanks for your interest and yes we will be working on improving the software in the coming weeks.
03/02/08 @ 03:01
Comment from: Chris Purcell [Visitor]
Unfortunately not working for me either. Running Windows XP on a dual-monitor system, the camera turns on (light comes on), but I only get a black screen, and nothing happens when I press 's'. Turning the second monitor off, no change.

Oddly, if I press 'n' the application appears to die, but actually needs force-quitting before it can be restarted.

Happy to help debug if you want.
03/02/08 @ 07:05
Comment from: Graham [Visitor] · http://www.fontgod.com
Excellent, downloading new version now. Hopefully my emailed suggestion regarding the fixed display resolution has resulted in a fix for me as well.
03/02/08 @ 20:26
Comment from: Graham [Visitor] Email · http://www.fontgod.com
Yippee... the resolution fix got me going.

Suggestion, you need a message to appear on screen telling you to press S to calibrate and start. People tend to avoid reading instructions. Also, the aspect ratio setting in the config file would be much easier if it just had an option for 16:9 (widescreen) or 4:3 (CRT) as most people wont be able to work out what their config should be.

A few bugs... it goes black occasionally and cant get it back. Also, it seems to always pan around one particular bubble (which changes each time you run it. The bubble isnt in the centre of the screen though, but its like a central pivot point. Is this normal?

Brilliant stuff though.... and quite interesting for me as it works along the exact same lines as a concept I came up with for a virtual pinball machine about a year ago. I think you can probably guess now what they might be.
03/02/08 @ 20:56
Comment from: Craig [Visitor]
I tried running within vista and with the visual studio debugger I am getting errors saying highguiSharper.dll cannot be loaded.
03/06/08 @ 19:05
Comment from: l0puk [Visitor]
My problem was that "." must be replaced with "," in Russian XP.
Can i get the sources? or should i use reflector for this?
03/12/08 @ 01:48
Comment from: Allen [Visitor] · http://www.rubikwillie.blogspot.com
not working for me either.. nothing happened after pressing "s"
03/24/08 @ 16:45
Comment from: Andy [Visitor]
not working for me either.
Athlon 4200+ dual core
2gb ram
geforce 7600gt agp 256mb gfx
logitech quickcam webcam
get error as soon as screen opens.
03/27/08 @ 10:31
Comment from: Danny [Visitor] · http://danielbaggio.blogspot.com
Hi Trungvo and Derek!
You guys are doing a really nice work.
I've updated the video with a faster version in my blog (http://danielbaggio.blogspot.com/2008/03/enhanced-version-of-head-tracking-and.html).
But I noticed you guys are doing 3D headtracking. My tracking is only 2D.
I guess you guys get distance info from eyes distance, right?
Have you got some open source code about it?
Thanks and congrats!
03/30/08 @ 09:29
Comment from: Brian [Visitor] Email · http://www.shitdirect.com
Working FANTASTIC! Amazing proof of concept, guys! (HW FYI: Creative Live Cam Video IM PRO, driver version 1.0.7.725, WinXP SP2)
04/02/08 @ 19:59
Comment from: Darryl [Visitor]
Great work, very compelling. Unfortunately I am getting the same problem as some others - screen is blank (beige), webcam is initialized, CPU is humming away, nothing is happening (pressing 's' doesn't affect it). Any suggestions?

WinXP, logitech webcam, .NET 2.0 installed ....
04/08/08 @ 08:08
Comment from: Knalle [Visitor]
why is the image squeezed together on my screen? I see big black borders on the sides and a narrow sky - the effect is not working at all in this condition.

I have a laptop with built-in webcam, the widescreen is 15". I havent changed the config, since the default is the right config.
04/09/08 @ 06:54
Comment from: A Computer Portal. Freeware PLUS [Visitor] · http://www.acomputerportal.com
I got an error when trying to install. I have .NET2
05/11/08 @ 03:13
Comment from: Daniel Mahan [Visitor] Email · http://vrmlstudent.50meg.com
very cool...took a little system reconfiguration on my part...had to get the appropriate .NET build, and I updated DirctX while I was at it...pretty nice...I've had some cool effects experimenting with different backgrounds as well...a path in the woods, and a field of flowers looked interesting...very much like looking through a window...
06/26/08 @ 21:45
Comment from: Dan [Visitor]
Works great - really, really cool effect.

Will keep coming back for updates!

Is this open source?
08/03/08 @ 11:32
Comment from: t s [Visitor] Email
i get error clr20r3 , i have .net 2.0 installed and i have everything else
08/04/08 @ 14:53
Comment from: podge [Visitor] Email
it doesnt work on my pc it says it has to close because of an error whenever i try to open it
08/18/08 @ 08:50
Comment from: Amith AV [Visitor] · http://www.imagine-x.com
Sorry...not working for me..
09/03/08 @ 03:21
Comment from: 9of9 [Visitor]
Very neat indeed! Worked first time, no problems for me.

It's a bit limited due to a lot of webcams' limited FOV (coupled with a 42" screen... *ahem* doesn't work too well) but it's cool to see this working in practice. There probably need to be better algorithms for dealing with the face going out of the picture, since it seems to just go off and do its own thing the moment it loses the face, otherwise it's a great start!
09/10/08 @ 22:55
Comment from: Petar Vasilev [Visitor] Email
Hi!
I installed Virtual Viewpoint successfully, but it runs a little bit slow and it's breaking sometimes. I have
GeForce 7300, 2GB RAM, 2.8 GHz processor
and DirectX 9.0. Guess it's no problem. Thanks!
10/07/08 @ 03:50
Comment from: Stuart Pryor [Visitor]
WOW - just got this to work on my MSI Wind (1.6ghz ATOM, 64mb G/C, 1g RAM). This is one of the best bits of software I have played with in years!!!!!
10/08/08 @ 08:12

This post has 5 feedbacks awaiting moderation...

Leave a comment


Your email address will not be revealed on this site.

Your URL will be displayed.
(Line breaks become <br />)
(Name, email & website)
(Allow users to contact you through a message form (your email will not be revealed.)