H04N2213/008

Utilizing dual cameras for continuous camera capture
11575877 · 2023-02-07 · ·

An eyewear device that adjusts an on time and an off time of a pair of cameras to control heat of the cameras and of the eyewear device. Each of the pair of cameras has a duty cycle determining when the respective camera is on and off. A camera control chart contains the duty cycles. The eyewear may have a temperature sensor such that the on and off times of the cameras are a function of the temperature sensor.

IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND IMAGE DISPLAY SYSTEM
20230007231 · 2023-01-05 · ·

There is provided an image processing device that processes a projection image presented to a plurality of persons at the same time. The image processing device specifies an overlapping area in which fields of view of two or more users overlap based on information on each user, classifies objects included in the overlapping area into a first object group and a second object group, generates a common image common to all users, made up of the first object group, generates individual images different for each user, made up of the second object group, and determines an output protocol for displaying the individual images.

Head-mounted display
11558602 · 2023-01-17 · ·

There is provided a head-mounted display comprising an image generator that generates an image, a pair of optical plates to be arranged in front of both eyes of an observer who observes the image, the pair of optical plates causing the image to be displayed, a first frame that holds the pair of optical plates, and a second frame including a to-be-fixed part, in which a fixing part to which the to-be-fixed part is fixed is provided at the central part of the first frame in the horizontal direction.

HYPER-CONNECTED AND SYNCHRONIZED AR GLASSES

Systems and methods are described for selectively sharing audio and video streams amongst electronic eyewear devices. Each electronic eyewear device includes a camera arranged to capture a video stream in an environment of the wearer, a microphone arranged to capture an audio stream in the environment of the wearer, and a display. A processor of each electronic eyewear device executes instructions to establish an always-on session with other electronic eyewear devices and selectively shares an audio stream, a video stream, or both with other electronic eyewear devices in the session. Each electronic eyewear device also generates and receives annotations from other users in the session for display with the selectively shared video stream on the display of the electronic eyewear device that provided the selectively shared video stream. The annotation may include manipulation of an object in the shared video stream or overlay images registered with the shared video stream.

AUGMENTED REALITY EYEWEAR WITH X-RAY EFFECT

Eyewear providing an interactive augmented reality experience to users in a first physical environment viewing objects in a second physical environment (e.g., X-ray effect). The second environment may be a room positioned behind a barrier, such as a wall. The user views the second environment via a sensor system moveable on the wall using a track system. As the user in the first environment moves the eyewear to face the outside surface of the wall along a line-of-sight (LOS) at a location (x, y, z), the sensor system on the track system repositions to the same location (x, y, z) on the inside surface of wall. The image captured by the sensor system in the second environment is wirelessly transmitted to the eyewear for displayed on the eyewear displays, providing the user with an X-ray effect of looking through the wall to see the objects within the other environment.

CALIBRATING SENSOR ALIGNMENT WITH APPLIED BENDING MOMENT

Examples are disclosed that relate to calibration data related to a determined alignment of sensors on a wearable display device. One example provides a wearable display device comprising a frame, a first sensor and a second sensor, one or more displays, a logic system, and a storage system. The storage system comprises calibration data related to a determined alignment of the sensors with the frame in a bent configuration and instructions executable by the logic system. The instructions are executable to obtain a first sensor data and a second sensor data respectfully from the first and second sensors, determine a distance from the wearable display device to a feature based at least upon the first and second sensor data using the calibration data, obtain a stereo image to display based upon the distance from the wearable display device to the feature, and output the stereo image via the displays.

Stereoscopic image display device, stereoscopic image display method, and program

[Problem] The present invention provides a stereoscopic image display device, stereoscopic image display method, and a program capable of displaying the display target with a constant size and a constant aspect ratio even when the distance between the stereoscopic image display device and the user changes. [Solution to Problem] The present invention provides a stereoscopic image display device comprising: a display part; an acquisition part configured to acquire an observation viewing distance that is a viewing distance from the display part to a user; and an adjustment part configured to adjust a display state of a display image based on a reference viewing distance and the observation viewing distance, wherein the display part is configured to display a stereoscopic image based on the display state.

Stereo viewing

The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.

System and method for presenting image content on multiple depth planes by providing multiple intra-pupil parallax views

An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity. Advantageously, the wavefront divergence, and the accommodation cue provided to the eye of the user, may be varied by appropriate selection of parallax disparity, which may be set by selecting the amount of spatial separation between the locations of light output.

Open view, multi-modal, calibrated digital loupe with depth sensing
11611735 · 2023-03-21 · ·

A digital loupe system is provided which can include a number of features. In one embodiment, the digital loupe system can include a stereo camera pair and a distance sensor. The system can further include a processor configured to perform a transformation to image signals from the stereo camera pair based on a distance measurement from the distance sensor and from camera calibration information. In some examples, the system can use the depth information and the calibration information to correct for parallax between the cameras to provide a multi-channel image. Ergonomic head mounting systems are also provided. In some implementations, the head mounting systems can be configurable to support the weight of a digital loupe system, including placing one or two oculars in a line of sight with an eye of a user, while improving overall ergonomics, including peripheral vision, comfort, stability, and adjustability. Methods of use are also provided.