Patent classifications
H04N13/15
Robust use of semantic segmentation for depth and disparity estimation
This disclosure relates to techniques for generating robust depth estimations for captured images using semantic segmentation. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Such segmentations may be binary (e.g., a ‘person pixel’ or a ‘non-person pixel’) or multi-class (e.g., a pixel may be labelled as: ‘person,’ ‘dog,’ ‘cat,’ etc.). As semantic segmentation techniques grow in accuracy and adoption, it is becoming increasingly important to develop methods of utilizing such segmentations and developing flexible techniques for integrating segmentation information into existing computer vision applications, such as depth and/or disparity estimation, to yield improved results in a wide range of image capture scenarios. In some embodiments, an optimization framework may be employed to optimize a camera device's initial scene depth/disparity estimates that employs both semantic segmentation and color regularization in a robust fashion.
Head mounted display and method
A system for displaying a mobile device screen comprises a head mounted display for displaying a first content to a user, a video camera mounted on the head mounted display, the video camera operable to capture a video image of a scene in front of the user, a region detection processor operable to detect a region of the captured video image comprising a mobile device screen, and an image processor operable to replace a corresponding region of the displayed first content in the head mounted display with the detected region of the captured video image comprising the mobile device screen.
Head mounted display and method
A system for displaying a mobile device screen comprises a head mounted display for displaying a first content to a user, a video camera mounted on the head mounted display, the video camera operable to capture a video image of a scene in front of the user, a region detection processor operable to detect a region of the captured video image comprising a mobile device screen, and an image processor operable to replace a corresponding region of the displayed first content in the head mounted display with the detected region of the captured video image comprising the mobile device screen.
Microscope made with CMOS camera(s)
A medical/surgical microscope with two cameras configured to capture two dimensional images of specimens being observed. The medical/surgical microscope is secured to a control apparatus configured to adjust toe-in of the two cameras to insure the convergence of the images. The medical/surgical microscope includes a computer system with a non-transitory memory apparatus for storing computer program code configured for digitally rendering real-world medical/surgical images. The medical/surgical microscope has an illumination system with controls for focusing and regulating the lighting of a specimen. The medical/surgical microscope is configured for real-time video display with the function of recording and broadcasting simultaneously during surgery.
Microscope made with CMOS camera(s)
A medical/surgical microscope with two cameras configured to capture two dimensional images of specimens being observed. The medical/surgical microscope is secured to a control apparatus configured to adjust toe-in of the two cameras to insure the convergence of the images. The medical/surgical microscope includes a computer system with a non-transitory memory apparatus for storing computer program code configured for digitally rendering real-world medical/surgical images. The medical/surgical microscope has an illumination system with controls for focusing and regulating the lighting of a specimen. The medical/surgical microscope is configured for real-time video display with the function of recording and broadcasting simultaneously during surgery.
THREE-DIMENSIONAL CONTOURED SCANNING PHOTOACOUSTIC IMAGING AND VIRTUAL STAINING
Methods, devices, apparatus, and systems for three-dimensional (3D) contoured scanning photoacoustic imaging and/or deep learning virtual staining.
THREE-DIMENSIONAL CONTOURED SCANNING PHOTOACOUSTIC IMAGING AND VIRTUAL STAINING
Methods, devices, apparatus, and systems for three-dimensional (3D) contoured scanning photoacoustic imaging and/or deep learning virtual staining.
Distance measuring device and optical mechanism thereof
A distance measuring device for measuring the distance to an object is provided, including a light-emitting module, a driving assembly disposed in the light-emitting module, and a light-receiving module. The light-emitting module has a housing, a light source disposed in the housing, a light grating element, and an optical path adjuster. The light source emits a measuring light through the optical path adjuster and the light grating element. The driving assembly can drive the optical path adjuster or the light grating element to move relative to the housing. The light-receiving module receives the measuring light which is reflected by the object to obtain distance information of the object.
Distance measuring device and optical mechanism thereof
A distance measuring device for measuring the distance to an object is provided, including a light-emitting module, a driving assembly disposed in the light-emitting module, and a light-receiving module. The light-emitting module has a housing, a light source disposed in the housing, a light grating element, and an optical path adjuster. The light source emits a measuring light through the optical path adjuster and the light grating element. The driving assembly can drive the optical path adjuster or the light grating element to move relative to the housing. The light-receiving module receives the measuring light which is reflected by the object to obtain distance information of the object.
WEARABLE ELECTRONIC DEVICE AND METHOD OF OUTPUTTING THREE-DIMENSIONAL IMAGE
A wearable electronic device includes a left-eye display configured to output light of a first color corresponding to a 3D left-eye image, a right-eye display configured to output light of a second color corresponding to a 3D right-eye image, a left-eye optical waveguide configured to adjust a path of the light of the first color and output the light of the first color, a right-eye optical waveguide configured to adjust a path of the light of the second color and output the light of the second color, a left-eye display control circuit configured to supply a driving power and a control signal to the left-eye display, a right-eye display control circuit configured to supply a driving power and a control signal to the right-eye display, a communication module configured to communicate with a mobile electronic device, and a second control circuit configured to supply a driving power and a control signal to the communication module.