For the Dutch National Museum of Ethnology we created a 25 meter wide interactive projection using 4 kinect v2’s en 7 projectors. Using the skeleton recognition of the Kinect SDK children standing in front of the wall are transformed into movable 2D puppets. Using the puppets children can play and fool around inside the projected virtual world.
The unique challenge of the project was to let the kinects field of views overlap while not duplicating any puppets. First I needed to develop a piece of software to interpret all of the incoming Kinect data to see which skeletons belong to the same person. This program enabled us to use an arbritrary amount of Kinect’s. All of the data is then broadcasted over the network. This made the setup very flexible and easily tweakable.