The present technology is a surgical image display system, an image processing device, and an image processing method that enable to assist grasping of a distance in a depth direction in a space in which a stereoscopic image is reproduced when a three-dimensional image is stereoscopically viewed. An image of an observation region is shot from two different viewpoints, and a three-dimensional image that reproduces a stereoscopic image of the observation region is acquired.

There is generated an output image that outputs the acquired three-dimensional image and depth distortion information that represents magnitude of distortion in a depth direction in a stereoscopic image space in which a stereoscopic image of the observation region is reproduced by stereoscopically viewing the three-dimensional image. The present technology can be applied to an operative field camera system for medical facilities that shoots an image of a field of view (operative field) of a surgical site.

A display device includes: a first display unit that displays a non-directional display image which is invariant regardless of a viewing direction of an observer; a second display unit that is disposed on a side opposite to an outer surface of the first display unit and has a plurality of pixels two-dimensionally arranged to display a display image having a different directional property in accordance with the viewing direction of the observer; an optical element array that is disposed in parallel with a light emission surface of the second display unit between the outer surface of the first display unit and the second display unit, in which a plurality of optical elements are arranged respectively corresponding to a predetermined unit of pixels among the plurality of pixels; and a driving unit that turns on a predetermined pixel among the plurality of pixels of the second display unit.

The present disclosure relates to a surgery support system, a display control device, and a display control method in which a plurality of images can be displayed in an easy-to-see and efficient manner. An information processing device generates a composite image by compositing images output from a plurality of electronic instruments including a medical instrument, and adds, to the composite image, metadata related to division of the composite image. The display control device controls a display device to display, in the virtual three-dimensional space, divided images obtained by dividing the composite image into a plurality of divided regions on the basis of the metadata. The present disclosure can be applied to an endoscopic surgical system, for example.

The present disclosure relates to a surgery support system, a display control device, and a display control method in which a plurality of images can be displayed in an easy-to-see and efficient manner. An information processing device generates a composite image by compositing images output from a plurality of electronic instruments including a medical instrument, and adds, to the composite image, metadata related to division of the composite image. The display control device controls a display device to display, in the virtual three-dimensional space, divided images obtained by dividing the composite image into a plurality of divided regions on the basis of the metadata. The present disclosure can be applied to an endoscopic surgical system, for example.

An image display device includes a display panel, a barrier panel, and a controller. The display panel is configured to be able to form a first display region, to be able to display a right-eye image in a right-eye visible region of the first display region and display a left-eye image in a left-eye visible region of the first display region. The barrier panel is configured to be able to form a first barrier region and to form a light-transmitting portion and a dimming portion in the first barrier region. The controller is configured to display a portion located in the first display region as one parallax image frame including two sub-frames. The controller is configured to form the dimming region in the entire first barrier region during a frame change period including a timing of changing a display from the parallax image frame to a new parallax image frame.

A mixed reality (MR) system is disclosed. The MR system may determine a first predicted head pose corresponding to a time that virtual reality imagery is rendered, determine a second predicted head pose corresponding to a selected point in time during a camera shutter period, and combine the virtual reality imagery with the stereoscopic imagery based on the first predicted head pose and the second predicted head pose. A simulator that employs remote (e.g., cloud) rendering is also disclosed. The simulator/client device may determine a first pose (e.g., vehicle pose and/or head pose), receive video imagery rendered by a remote server based on the first pose, and apply a timewarp correction to the video imagery based on a comparison of the first pose and a second pose.

A mixed reality (MR) system is disclosed. The MR system may determine a first predicted head pose corresponding to a time that virtual reality imagery is rendered, determine a second predicted head pose corresponding to a selected point in time during a camera shutter period, and combine the virtual reality imagery with the stereoscopic imagery based on the first predicted head pose and the second predicted head pose. A simulator that employs remote (e.g., cloud) rendering is also disclosed. The simulator/client device may determine a first pose (e.g., vehicle pose and/or head pose), receive video imagery rendered by a remote server based on the first pose, and apply a timewarp correction to the video imagery based on a comparison of the first pose and a second pose.

A transmittance control apparatus includes a first identifier configured to identify, based on display information indicating a target for display, a degree of lightness of the target for display; a second identifier configured to identify lightness of an environment in which a see-through display is disposed; a transmittance controller configured to: when the degree of lightness of the target for display does not fluctuate and the lightness of the environment fluctuates in a range less than or equal to a first lightness, reduce transmittance of the target for display displayed on the see-through display with an increase in the lightness of the environment; and control the transmittance of the target for display displayed on the see-through display at a first timing based on: a maximum lightness of the environment in a first period before to the first timing and the degree of lightness of the target for display.

A transmittance control apparatus includes a first identifier configured to identify, based on display information indicating a target for display, a degree of lightness of the target for display; a second identifier configured to identify lightness of an environment in which a see-through display is disposed; a transmittance controller configured to: when the degree of lightness of the target for display does not fluctuate and the lightness of the environment fluctuates in a range less than or equal to a first lightness, reduce transmittance of the target for display displayed on the see-through display with an increase in the lightness of the environment; and control the transmittance of the target for display displayed on the see-through display at a first timing based on: a maximum lightness of the environment in a first period before to the first timing and the degree of lightness of the target for display.

A method for displaying virtual content to a user, the method includes determining an accommodation of the user's eyes. The method also includes delivering, through a first waveguide of a stack of waveguides, light rays having a first wavefront curvature based at least in part on the determined accommodation, wherein the first wavefront curvature corresponds to a focal distance of the determined accommodation. The method further includes delivering, through a second waveguide of the stack of waveguides, light rays having a second wavefront curvature, the second wavefront curvature associated with a predetermined margin of the focal distance of the determined accommodation.