H04N13/156

WEARABLE ELECTRONIC DEVICE AND METHOD OF OUTPUTTING THREE-DIMENSIONAL IMAGE
20220360764 · 2022-11-10 ·

A wearable electronic device includes a left-eye display configured to output light of a first color corresponding to a 3D left-eye image, a right-eye display configured to output light of a second color corresponding to a 3D right-eye image, a left-eye optical waveguide configured to adjust a path of the light of the first color and output the light of the first color, a right-eye optical waveguide configured to adjust a path of the light of the second color and output the light of the second color, a left-eye display control circuit configured to supply a driving power and a control signal to the left-eye display, a right-eye display control circuit configured to supply a driving power and a control signal to the right-eye display, a communication module configured to communicate with a mobile electronic device, and a second control circuit configured to supply a driving power and a control signal to the communication module.

WEARABLE ELECTRONIC DEVICE AND METHOD OF OUTPUTTING THREE-DIMENSIONAL IMAGE
20220360764 · 2022-11-10 ·

A wearable electronic device includes a left-eye display configured to output light of a first color corresponding to a 3D left-eye image, a right-eye display configured to output light of a second color corresponding to a 3D right-eye image, a left-eye optical waveguide configured to adjust a path of the light of the first color and output the light of the first color, a right-eye optical waveguide configured to adjust a path of the light of the second color and output the light of the second color, a left-eye display control circuit configured to supply a driving power and a control signal to the left-eye display, a right-eye display control circuit configured to supply a driving power and a control signal to the right-eye display, a communication module configured to communicate with a mobile electronic device, and a second control circuit configured to supply a driving power and a control signal to the communication module.

Stereo viewing

The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.

Stereo viewing

The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.

Stereoscopic camera with fluorescence visualization

A stereoscopic camera with fluorescence visualization is disclosed. An example stereoscopic camera includes a visible light source, a near-infrared light source, and a near-ultraviolet light source. The stereoscopic camera also includes a light filter assembly having left and right filter magazines positioned respectively along left and right optical paths and configured to selectively enable certain wavelengths of light to pass through. Each of the left and right filter magazines includes an infrared cut filter, a near-ultraviolent cut filter, and a near-infrared bandpass filter. A controller of the camera is configured to provide for a visible light mode, an indocyanine green (“ICG”) fluorescence mode, and a 5-aminolevulinic acid (“ALA”) fluorescence mode by synchronizing the activation of the light sources with the selection of the filters. A processor of the camera combines image data from the different modes to enable fluorescence emission light to be superimposed on visible light stereoscopic images.

Stereoscopic camera with fluorescence visualization

A stereoscopic camera with fluorescence visualization is disclosed. An example stereoscopic camera includes a visible light source, a near-infrared light source, and a near-ultraviolet light source. The stereoscopic camera also includes a light filter assembly having left and right filter magazines positioned respectively along left and right optical paths and configured to selectively enable certain wavelengths of light to pass through. Each of the left and right filter magazines includes an infrared cut filter, a near-ultraviolent cut filter, and a near-infrared bandpass filter. A controller of the camera is configured to provide for a visible light mode, an indocyanine green (“ICG”) fluorescence mode, and a 5-aminolevulinic acid (“ALA”) fluorescence mode by synchronizing the activation of the light sources with the selection of the filters. A processor of the camera combines image data from the different modes to enable fluorescence emission light to be superimposed on visible light stereoscopic images.

VIDEO PROCESSING METHOD AND APPARATUS, AND DEVICE, DECODER, SYSTEM AND STORAGE MEDIUM
20230100615 · 2023-03-30 ·

Disclosed are a video processing method and apparatus, and a device, a decoder, a system and a storage medium, applied to a video device. The method comprises: obtaining a video sequence of a first resolution, the video sequence comprising at least one video frame; and inputting the video sequence into a super-resolution network model to obtain a target video sequence of a second resolution, wherein the super-resolution network model at least comprises a first sub-network model and a second sub-network model, the first sub-network model is used for improving the resolution of the video sequence, and the second sub-network model is used for improving the quality of at least one image frame in the output result of the first sub-network model.

VIDEO PROCESSING METHOD AND APPARATUS, AND DEVICE, DECODER, SYSTEM AND STORAGE MEDIUM
20230100615 · 2023-03-30 ·

Disclosed are a video processing method and apparatus, and a device, a decoder, a system and a storage medium, applied to a video device. The method comprises: obtaining a video sequence of a first resolution, the video sequence comprising at least one video frame; and inputting the video sequence into a super-resolution network model to obtain a target video sequence of a second resolution, wherein the super-resolution network model at least comprises a first sub-network model and a second sub-network model, the first sub-network model is used for improving the resolution of the video sequence, and the second sub-network model is used for improving the quality of at least one image frame in the output result of the first sub-network model.

Surgical Systems with Intraluminal and Extraluminal Cooperative Instruments

Surgical systems are provided. In one exemplary embodiment, a surgical system includes a first scope device having a first portion within an extraluminal space and a second portion positioned within an intraluminal space. The first scope device transmits image data of a first scene. A second scope device is disposed within the extraluminal space and transmits image data of a second scene. The first portion of the first instrument is present within the field of view of the second scope device to track the first scope device relative to the second scope device. A controller receives the transmitted image data of the first and second scenes, to determine a relative distance from the first scope device to the second scope device within the extraluminal space, and to provide a merged image. At least one of the first and second scope device in the merged image is a representative depiction thereof.

Surgical Systems with Intraluminal and Extraluminal Cooperative Instruments

Surgical systems are provided. In one exemplary embodiment, a surgical system includes a first scope device having a first portion within an extraluminal space and a second portion positioned within an intraluminal space. The first scope device transmits image data of a first scene. A second scope device is disposed within the extraluminal space and transmits image data of a second scene. The first portion of the first instrument is present within the field of view of the second scope device to track the first scope device relative to the second scope device. A controller receives the transmitted image data of the first and second scenes, to determine a relative distance from the first scope device to the second scope device within the extraluminal space, and to provide a merged image. At least one of the first and second scope device in the merged image is a representative depiction thereof.