Patent classifications
H04N13/139
INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM
The information processing system obtains a plurality of images based on image capturing by a plurality of imaging devices; obtains viewpoint information for specifying a position of a virtual viewpoint and a view direction from the virtual viewpoint; and generates a plurality of virtual viewpoint contents each of which corresponds to one of a plurality of image formats based on the common plurality of obtained images and the obtained viewpoint information, and the plurality of image formats is image formats whose numbers of virtual viewpoints specified by the viewpoint information used for generation of the virtual viewpoint contents are different from one another.
INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM
The information processing system obtains a plurality of images based on image capturing by a plurality of imaging devices; obtains viewpoint information for specifying a position of a virtual viewpoint and a view direction from the virtual viewpoint; and generates a plurality of virtual viewpoint contents each of which corresponds to one of a plurality of image formats based on the common plurality of obtained images and the obtained viewpoint information, and the plurality of image formats is image formats whose numbers of virtual viewpoints specified by the viewpoint information used for generation of the virtual viewpoint contents are different from one another.
Coding and decoding of interleaved image data
Sampled data is packaged in checkerboard format for encoding and decoding. The sampled data may be quincunx sampled multi-image video data (e.g., 3D video or a multi-program stream), and the data may also be divided into sub-images of each image which are then multiplexed, or interleaved, in frames of a video stream to be encoded and then decoded using a standardized video encoder. A system for viewing may utilize a standard video decoder and a formatting device that de-interleaves the decoded sub-images of each frame reformats the images for a display device. A 3D video may be encoded using a most advantageous interleaving format such that a preferred quality and compression ratio is reached. In one embodiment, the invention includes a display device that accepts data in multiple formats.
METHODS FOR GENERATING STEREOSCOPIC VIEWS IN MULTICAMERA SYSTEMS, AND ASSOCIATED DEVICES AND SYSTEMS
Methods for selecting pairs of cameras in a multicamera array configured to image a scene to generate stereoscopic views, and associated systems and devices, are disclosed herein. In some embodiments, a representative method includes selecting a pair of cameras in the multicamera array from which to generate a stereoscopic view, and receiving images of the scene from the selected pair of the cameras. The method further includes cropping the images based on a known calibration of the cameras and a desired disparity, and displaying the cropped images on a display device to generate the stereoscopic view. The desired disparity can correspond to an interpupillary distance of a user.
METHODS FOR GENERATING STEREOSCOPIC VIEWS IN MULTICAMERA SYSTEMS, AND ASSOCIATED DEVICES AND SYSTEMS
Methods for selecting pairs of cameras in a multicamera array configured to image a scene to generate stereoscopic views, and associated systems and devices, are disclosed herein. In some embodiments, a representative method includes selecting a pair of cameras in the multicamera array from which to generate a stereoscopic view, and receiving images of the scene from the selected pair of the cameras. The method further includes cropping the images based on a known calibration of the cameras and a desired disparity, and displaying the cropped images on a display device to generate the stereoscopic view. The desired disparity can correspond to an interpupillary distance of a user.
Electronic device for adjusting position of content displayed on display based on ambient illuminance and method for operating same
Disclosed is an electronic device including at least one sensor, a first display configured to output a first image corresponding to content for a left eye of a user and a second display configured to output a second image corresponding to the content for a right eye of the user, and a processor configured to display, using the first display and the second display, the content in a virtual display region through a glass plate of the smart glass, identify a state of the smart glass using the at least one sensor, based on identifying that a sensor value of the at least one sensor indicating the state of the smart glass is less than a preset value, adjust at least one of a display position or a size of the content in the virtual display region such that the content is displayed in a first display region corresponding to a first field of view (FOV) of a user that is narrowed according to the state of the smart glass, and based on identifying that the sensor value is greater than the preset value, adjust the at least one of the display position or the size of the content in the virtual display region such that the content is displayed in a second display region corresponding to a second FOV of the user that is broadened according to the state of the smart glass, the second FOV having a broader view angle and a shorter focal length than the first FOV.
Electronic device for adjusting position of content displayed on display based on ambient illuminance and method for operating same
Disclosed is an electronic device including at least one sensor, a first display configured to output a first image corresponding to content for a left eye of a user and a second display configured to output a second image corresponding to the content for a right eye of the user, and a processor configured to display, using the first display and the second display, the content in a virtual display region through a glass plate of the smart glass, identify a state of the smart glass using the at least one sensor, based on identifying that a sensor value of the at least one sensor indicating the state of the smart glass is less than a preset value, adjust at least one of a display position or a size of the content in the virtual display region such that the content is displayed in a first display region corresponding to a first field of view (FOV) of a user that is narrowed according to the state of the smart glass, and based on identifying that the sensor value is greater than the preset value, adjust the at least one of the display position or the size of the content in the virtual display region such that the content is displayed in a second display region corresponding to a second FOV of the user that is broadened according to the state of the smart glass, the second FOV having a broader view angle and a shorter focal length than the first FOV.
Stereoscopic endoscope system
A stereoscopic endoscope system includes a stereoscopic endoscope and an identification information combining section. The stereoscopic endoscope is provided with an R image pickup section and an R output section which are provided on a right side of an endoscope body, an L image pickup section and an L output section which are provided on a left side of the endoscope body, and an R memory and an L memory which store correction information for either right or left and identification information. The right and left image pickup sections and the right and left memories are correctly or incorrectly combined and are connected to the right and left output sections. The identification information combining section performs image combination of an image and identification information inputted from the R output section or an image and identification information inputted from the L output section and outputs a combined image.
Method and system for near-eye focal plane overlays for 3D perception of content on 2D displays
Some embodiments of a method may include: identifying two-dimensional (2D) content present in an image of a real-world scene; retrieving metadata comprising depth information associated with the 2D content; generating a plurality of focal plane images using the metadata, the plurality of focal plane images comprising depth cues for the 2D content; and displaying the plurality of focal plane images as a see-through overlay synchronized with the 2D content.
Method and system for near-eye focal plane overlays for 3D perception of content on 2D displays
Some embodiments of a method may include: identifying two-dimensional (2D) content present in an image of a real-world scene; retrieving metadata comprising depth information associated with the 2D content; generating a plurality of focal plane images using the metadata, the plurality of focal plane images comprising depth cues for the 2D content; and displaying the plurality of focal plane images as a see-through overlay synchronized with the 2D content.