In some aspects, the techniques described herein relate to systems, methods, and computer readable media for data pre-processing for stereo-temporal image sequences to improve three-dimensional data reconstruction. In some aspects, the techniques described herein relate to systems, methods, and computer readable media for improved correspondence refinement for image areas affected by oversaturation. In some aspects, the techniques described herein relate to systems, methods, and computer readable media configured to fill missing correspondences to improve three-dimensional (3-D) reconstruction. The techniques include identifying image points without correspondences, using existing correspondences and/or other information to generate approximated correspondences, and cross-checking the approximated correspondences to determine whether the approximated correspondences should be used for the image processing.

The present disclosure provides a communication method, and an electronic device. The method includes: obtaining, by an electronic device, a plurality of 2D images and/or a plurality of depth maps for a current scene, the plurality of 2D images and/or the plurality of depth maps being aligned in time; and transmitting, by the electronic device, the plurality of 2D images and/or the plurality of depth maps to the server by means of wireless communication.

The present disclosure provides a communication method, and an electronic device. The method includes: obtaining, by an electronic device, a plurality of 2D images and/or a plurality of depth maps for a current scene, the plurality of 2D images and/or the plurality of depth maps being aligned in time; and transmitting, by the electronic device, the plurality of 2D images and/or the plurality of depth maps to the server by means of wireless communication.

A visualization system including multiple light sources, an image sensor configured to detect imaging data from the multiple light sources, and a control circuit is disclosed. At least one of the light sources is configured to emit a pattern of structured light. The control circuit is configured to receive the imaging data from the image sensor, generate a three-dimensional digital representation of the anatomical structure from the pattern of structured light detected by the imaging data, obtain metadata from the imaging data, overlay the metadata on the three-dimensional digital representation, receive updated imaging data from the image sensor, and generate an updated three-dimensional digital representation of the anatomical structure based on the updated imaging data. The visualization system can be communicatively coupled to a situational awareness module configured to determine a surgical scenario based on input signals from multiple surgical devices.

A visualization system including multiple light sources, an image sensor configured to detect imaging data from the multiple light sources, and a control circuit is disclosed. At least one of the light sources is configured to emit a pattern of structured light. The control circuit is configured to receive the imaging data from the image sensor, generate a three-dimensional digital representation of the anatomical structure from the pattern of structured light detected by the imaging data, obtain metadata from the imaging data, overlay the metadata on the three-dimensional digital representation, receive updated imaging data from the image sensor, and generate an updated three-dimensional digital representation of the anatomical structure based on the updated imaging data. The visualization system can be communicatively coupled to a situational awareness module configured to determine a surgical scenario based on input signals from multiple surgical devices.

A data processing method performed by a computer for detecting reflections of light pulses, comprising the steps: acquiring a camera signal representing a series of camera images of a camera viewing field; detecting whether the camera signal includes one or more light mark portions within the camera viewing field possibly representing a light pulse reflection; relating the detected light mark portions in the series of camera images to a pre-defined emission pattern of the light pulses; and determining that a light mark portion is a reflected light pulse, if the light mark portion in the series of camera images matches to the pre-defined emission pattern of the light pulses.

A data processing method performed by a computer for detecting reflections of light pulses, comprising the steps: acquiring a camera signal representing a series of camera images of a camera viewing field; detecting whether the camera signal includes one or more light mark portions within the camera viewing field possibly representing a light pulse reflection; relating the detected light mark portions in the series of camera images to a pre-defined emission pattern of the light pulses; and determining that a light mark portion is a reflected light pulse, if the light mark portion in the series of camera images matches to the pre-defined emission pattern of the light pulses.

The present disclosure relates to structured illumination. The teachings thereof may be embodied in devices for reconstruction of a three-dimensional surface of an object by means of a structured illumination for projection of measurement patterns onto the object. For example, a device may include: a projector unit for diffractive projection of a measurement pattern comprising a plurality of measurement points onto the surface; an acquisition unit for acquiring the measurement pattern from the surface; and a computer unit for reconstruction of the surface from a respective distortion of the measurement pattern. All possible positions of measurement elements are contained in the measurement pattern in repeating groups, in which a respective combination of measurement points represents a respective location in the measurement pattern.

A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.

A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.