What were the main technical challenges that you faced/are still facing with Virtual Drums?
We wanted to develop a system that was
- accurate
- cheap
- a nice 3d rendering and interface
- excellent sound quality
- fun
The main problem was to keep the product cheap, using cheap cameras, which means not-so-good quality. This has many consequences on the video analysis, because we had to be very careful with video noise ; also the lenses had huge geometricdistortions . We had to produce several prototypes for the stick so that it works perfectly under any light environment. After several weeks of hard work we reached a state where the virtual drums was working with any background, any type and intensity of light, and with our cheap cameras. We were really proud :-)
More information about the technology behind the virtual drums.