A system for executing a three-dimensional (3D) intraoperative scan of a patient is disclosed. A 3D scanner controller projects the object points included onto a first image plane and the object points onto a second image plane. The 3D scanner controller determines first epipolar lines associated with the first image plane and second epipolar lines associated with the second image plane based on an epipolar plane that triangulates the object points included in the first 2D intraoperative image to the object points included in the second 2D intraoperative image. Each epipolar lines provides a depth of each object as projected onto the first image plane and the second image plane. The 3D scanner controller converts the first 2D intraoperative image and the second 2D intraoperative image to the 3D intraoperative scan of the patient based on the depth of each object point provided by each corresponding epipolar line.

There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform controlling a delivery of a video conference call to a viewport, setting a timer and an event-based threshold with respect to the video conference call, determining whether any of the timer and the event-based threshold have been triggered based on any of an elapsed time and an event, and further controlling the delivery of the video conference call to the viewport based on determining whether any of the timer and the event-based threshold have been triggered.

The present application relates to an extended reality service providing method and system for operation of an industrial installation. More specifically, various types of data required for operation (e.g., inspection, examination, maintenance, repair, and reinforcement) of an industrial installation are digitalized, extended reality content, such as an augmented reality image or a mixed reality image based on the digitalized data, is provided to a site worker or a remote place manager, and the worker and the manager can communicate via a video call in real-time, whereby the work efficiency of the worker and the manager can be enhanced.

Light projection systems and methods may comprise combining light from two or more projectors. Each projector may be controlled so that the combined light output of the projectors matches a target for the projected light. In some embodiments optimization is performed to generate image data and control signals for each of the projectors. Embodiments may be applied in image projecting applications, lighting applications, and 3D stereoscopic imaging.

Light projection systems and methods may comprise combining light from two or more projectors. Each projector may be controlled so that the combined light output of the projectors matches a target for the projected light. In some embodiments optimization is performed to generate image data and control signals for each of the projectors. Embodiments may be applied in image projecting applications, lighting applications, and 3D stereoscopic imaging.

A head-mounted device (HMD) of a first user has a transparent display. The HMD determines location information of a second user relative to the HMD of the first user. The second user is located within a predefined distance of the HMD. The location information identifies a distance and a direction of the second user relative to the HMD. The HMD receives audio content from the second user, generates augmented reality (AR) content based on the audio content, and displays the AR content in the transparent display based on the location information of the second user. The AR content appears coupled to the second user.

A head-mounted device (HMD) of a first user has a transparent display. The HMD determines location information of a second user relative to the HMD of the first user. The second user is located within a predefined distance of the HMD. The location information identifies a distance and a direction of the second user relative to the HMD. The HMD receives audio content from the second user, generates augmented reality (AR) content based on the audio content, and displays the AR content in the transparent display based on the location information of the second user. The AR content appears coupled to the second user.

A system for displaying a stereo image is disclosed. The system includes a stereoscopic head up display (HUD) that includes a combiner and a display configured to display a stereo image. The system further includes either a head tracking sensor or an eye tracking sensor configured to generate a tracking dataset. The system further includes a processor and a memory with instructions that cause the processor to receive the tracking dataset, generate a distortion map based on the tracking dataset and a distortion function, receive a media stereo image, generate a stereo signal based on the distortion map and the media stereo image, and transmit the stereo signal to the display. The system is capable of conveying an image to an operator in the absence of a relay lens.

A system for displaying a stereo image is disclosed. The system includes a stereoscopic head up display (HUD) that includes a combiner and a display configured to display a stereo image. The system further includes either a head tracking sensor or an eye tracking sensor configured to generate a tracking dataset. The system further includes a processor and a memory with instructions that cause the processor to receive the tracking dataset, generate a distortion map based on the tracking dataset and a distortion function, receive a media stereo image, generate a stereo signal based on the distortion map and the media stereo image, and transmit the stereo signal to the display. The system is capable of conveying an image to an operator in the absence of a relay lens.

A system, method, and Head-Mounted Display, HMD, apparatus for recording a video and playing back the video to a viewer in a Virtual Reality, VR, environment. A geographical area is recorded with an omnidirectional video recording camera by dividing the geographical area into a plurality of area portions and recording in separate video sections, each of the area portions while moving the camera in different directions. Time points in each video section are associated with virtual locations of the view. At a time point providing the viewer with a choice of directions to proceed, the system receives the viewer's choice and presents to the viewer, a video section corresponding to the virtual location of the viewer and the desired direction of movement. The viewer's choice may be indicated by detecting a direction of the viewer's field of view or by receiving from the viewer, a response to a banner notification.