A modular holding fixture for selectively coupling to a wireless hand-held inertial controller to provide passive optical and inertial tracking in a slim form-factor for use with a head mounted display that operates with six degrees of freedom by fusing (i) data related to the position of the controller derived from a forward-facing depth camera located in the head mounted display with (ii) data relating to the orientation of the controller derived from an inertial measurement unit located in the controller

An intra-oral optical scanning method for intra-oral optical scanning including projecting a pattern, the pattern including at least a first area illuminated by a first color of light and a second area illuminated by a second color of light and at least one non-illuminated area onto an intra-oral feature, making a first image of the first area, the second area and the non-illuminated area differentiating between the first color of light and the second color of light in the first image of the projected pattern, and determining from the image of the non-illuminated area at least one of an ambient light level, a level of scattered light, a level of light absorption and a level of light reflected from at least one of the first area and the second area. Related apparatus and methods are also described.

An intra-oral optical scanning method for intra-oral optical scanning including projecting a pattern, the pattern including at least a first area illuminated by a first color of light and a second area illuminated by a second color of light and at least one non-illuminated area onto an intra-oral feature, making a first image of the first area, the second area and the non-illuminated area differentiating between the first color of light and the second color of light in the first image of the projected pattern, and determining from the image of the non-illuminated area at least one of an ambient light level, a level of scattered light, a level of light absorption and a level of light reflected from at least one of the first area and the second area. Related apparatus and methods are also described.

A photographing device includes a first image sensor, a first filter area, a second image sensor, a first distance calculating unit, and a second distance calculating unit. The first image sensor includes a first sensor receiving light of a first wavelength band and outputting a target image, and a second sensor receiving light of a second wavelength band and outputting a reference image. The first filter area transmits a first light of a third wavelength band, which includes at least part of the first wavelength band, the first light being a part of light incident on the first image sensor. The second image sensor outputs a first image. The first distance calculating unit calculates a first distance to an object captured in the target image and the reference image. The second distance calculating unit calculates a second distance to an object captured in the reference image and the first image.

A multi-modal sensor system includes: an underlying sensor system; a polarization camera system configured to capture polarization raw frames corresponding to a plurality of different polarization states; and a processing system including a processor and memory, the processing system being configured to control the underlying sensor system and the polarization camera system, the memory storing instructions that, when executed by the processor, cause the processor to: control the underlying sensor system to perform sensing on a scene and the polarization camera system to capture a plurality of polarization raw frames of the scene; extract first tensors in polarization representation spaces based on the plurality of polarization raw frames; and compute a characterization output based on an output of the underlying sensor system and the first tensors in polarization representation spaces.

A multi-modal sensor system includes: an underlying sensor system; a polarization camera system configured to capture polarization raw frames corresponding to a plurality of different polarization states; and a processing system including a processor and memory, the processing system being configured to control the underlying sensor system and the polarization camera system, the memory storing instructions that, when executed by the processor, cause the processor to: control the underlying sensor system to perform sensing on a scene and the polarization camera system to capture a plurality of polarization raw frames of the scene; extract first tensors in polarization representation spaces based on the plurality of polarization raw frames; and compute a characterization output based on an output of the underlying sensor system and the first tensors in polarization representation spaces.

One variation of a system for capturing a textured 3D scan of an human body includes: a base configured to support a user; a sensor assembly configured to record optical scans; a robotic arm coupled to the base and configured to move the sensor assembly along a helical path extending upwardly from and around the base during a scanning routine; and a controller configured to stitch optical scans recorded by the sensor assembly during the scanning routine into the 3D scan of the human body of the user.

An image processing apparatus is provided, that is configured to: extract a first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image, at a target pixel position from image data having the first pixel value; extract second and third luminance values corresponding to second and third viewpoints that are different from the first viewpoint, at the target pixel position from luminance image data having the second and third luminance values; and calculate at least any of second and third pixel values of the second and third viewpoints such that a relational expression between the second or third pixel value and the first pixel value extracted by the pixel value extracting unit remains correlated with a relational expression defined by the second and third luminance values.

A perspective-correct communication window system and method for communicating between participants in an online meeting, where the participants are not in the same physical locations. Embodiments of the system and method provide an in-person communications experience by changing virtual viewpoint for the participants when they are viewing the online meeting. The participant sees a different perspective displayed on a monitor based on the location of the participant's eyes. Embodiments of the system and method include a capture and creation component that is used to capture visual data about each participant and create a realistic geometric proxy from the data. A scene geometry component is used to create a virtual scene geometry that mimics the arrangement of an in-person meeting. A virtual viewpoint component displays the changing virtual viewpoint to the viewer and can add perceived depth using motion parallax.

An imaging system includes a light source that, in operation, emits an emitted light containing a near-infrared light in a first wavelength region, an image sensor, and a double-band pass filter that transmits a visible light in at least a part of a wavelength region out of a visible region and the near-infrared light in the first wavelength region. The image sensor includes light detection cells, a first filter that selectively transmits the near-infrared light in the first wavelength region, second to fourth filters that selectively transmit lights in second to fourth wavelength regions, respectively, which are contained in the visible light, and an infrared absorption filter. The infrared absorption filter faces the second to fourth filters and absorbs the near-infrared light in the first wavelength region.