Notes:
This shows the conseptual setup. We have one stereocamera that captures two videostreams of an object. One left and one right videostream. The object here represented as a cube would represent the visible surface inside the chest cavity in the anatomical problem. A smaller cube hidden inside not visible for the camera represents the lima. We have a preoperative segmented CT scan of the data set which is stored on a computer.
The camera is continously being tracked by an optical tracking system and by using the stereodata in combination with the tracker information we want to find the correspondence between the camera view and the CD data. The hidden object is then using the correspondence information superimposed on the videostream.