According to an embodiment, an image processing device includes a receiver, a determiner, and a generator. The receiver is configured to receive a three-dimensional position in a coordinate system of three-dimensional data including an object. The determiner is configured to determine placement of a three-dimensional pointer having a first 3D shape and a second 3D shape positioned around the first 3D shape so that a position of the first 3D shape corresponds to the received three-dimensional position. The generator is configured to generate a stereoscopic image representing the three-dimensional pointer and the object.

A portable device includes a display module, an image capture module, and an eye-tracking module. The image capture module is used to capture images steadily. The eye-tracking module is used to track a user's viewpoint position relative to the portable device. Viewport within the images captured by the image capture module is adjusted in accordance with the user's viewpoint position for generating modified images displayed on the display module instantaneously. The modified images shown on the display module can fit the background scene seen by the user, and the augmented reality experience on the portable device may be improved accordingly.

A portable device includes a display module, an image capture module, and an eye-tracking module. The image capture module is used to capture images steadily. The eye-tracking module is used to track a user's viewpoint position relative to the portable device. Viewport within the images captured by the image capture module is adjusted in accordance with the user's viewpoint position for generating modified images displayed on the display module instantaneously. The modified images shown on the display module can fit the background scene seen by the user, and the augmented reality experience on the portable device may be improved accordingly.

The present application provides a light-field display apparatus. The apparatus includes: a display screen, the display screen including N display regions, each display region of the N display regions including M light-emitting points, and light-emitting points at a corresponding position of the N display regions being a light-emitting point group; driving circuits, configured to drive the light-emitting points to emit light; a lens group including at least one lens, the light-emitting points in the N display regions forming view zones corresponding one by one to the N display regions by the lens group, wherein light-emitting points belonging to a same light-emitting point group in the N display regions are driven by a same driving circuit, the N view zones are not overlapped with each other, and both N and M are positive integers greater than 1.

Methods, apparatus and systems for geometric matching of virtual reality (VR) or augmented reality (AR) output contemporaneously with video output formatted for display on a 2D screen include a determination of value sets that when used in image processing cause an off-screen angular field of view of the at least one of the AR output object or the VR output object to have a fixed relationship to at least one of the angular field of view of the onscreen object or of the 2D screen. The AR/VR output object is outputted to an AR/VR display device and the user experience is improved by the geometric matching between objects observed on the AR/VR display device and corresponding objects appearing on the 2D screen.

Methods, apparatus and systems for geometric matching of virtual reality (VR) or augmented reality (AR) output contemporaneously with video output formatted for display on a 2D screen include a determination of value sets that when used in image processing cause an off-screen angular field of view of the at least one of the AR output object or the VR output object to have a fixed relationship to at least one of the angular field of view of the onscreen object or of the 2D screen. The AR/VR output object is outputted to an AR/VR display device and the user experience is improved by the geometric matching between objects observed on the AR/VR display device and corresponding objects appearing on the 2D screen.

Methods, apparatus, devices, and systems for displaying three-dimensional objects by individually diffracting different colors of light are provided. In one aspect, a system includes a display having a plurality of display elements and an optical device configured to diffract a plurality of different colors of light to the display. The optical device is configured such that, when the plurality of different colors of light is incident on the optical device, the optical device separates light of individual colors of the different colors while suppressing crosstalk between the different colors.

Methods, apparatus, devices, and systems for displaying three-dimensional objects by individually diffracting different colors of light are provided. In one aspect, a system includes a display having a plurality of display elements and an optical device configured to diffract a plurality of different colors of light to the display. The optical device is configured such that, when the plurality of different colors of light is incident on the optical device, the optical device separates light of individual colors of the different colors while suppressing crosstalk between the different colors.

A system, method, and apparatus for displaying a fused reconstructed image with a multidimensional image are disclosed. An example imaging system receives a selection corresponding to a portion of a displayed multidimensional visualization of a surgical site. At the selected portion of the multidimensional visualization, the imaging system displays a portion of a three-dimensional image which corresponds to the selected multidimensional visualization such that the displayed portion of the at least one of the three-dimensional image or model is fused with the displayed multidimensional visualization.

A system, method, and apparatus for displaying a fused reconstructed image with a multidimensional image are disclosed. An example imaging system receives a selection corresponding to a portion of a displayed multidimensional visualization of a surgical site. At the selected portion of the multidimensional visualization, the imaging system displays a portion of a three-dimensional image which corresponds to the selected multidimensional visualization such that the displayed portion of the at least one of the three-dimensional image or model is fused with the displayed multidimensional visualization.