Radar, lidar, and other active 3D imaging techniques require large, heavy sensors that consume lots of power. Passive 3D imaging techniques based on feature matching are computationally expensive and limited by the quality of the feature matching. Fortunately, there is a robust, computationally inexpensive way to generate 3D images from full-motion video acquired from a platform that moves relative to the scene. The full-motion video frames are registered to each other and mapped to the scene coordinates using data about the trajectory of the platform with respect to the scene. The time derivative of the registered frames equals the product of the height map of the scene, the projected angular velocity of the platform, and the spatial gradient of the registered frames. This relationship can be solved in (near) real time to produce the height map of the scene from the full-motion video and the trajectory.

A device for generating a photometric stereo image and a color image of an object which is moved at a predetermined relative speed relative to the device. The device includes a lighting area and a lighting arrangement which is oriented to the lighting area. The lighting arrangement cyclically emits a lighting sequence in the lighting area. The lighting sequence has at least four lighting pulses each of which have a wavelength range and a lighting direction. At least three of the at least four lighting pulses have a different wavelength range, and at least two of the at least four lighting pulses have a different lighting direction and a same wavelength range.

A device for generating a photometric stereo image and a color image of an object which is moved at a predetermined relative speed relative to the device. The device includes a lighting area and a lighting arrangement which is oriented to the lighting area. The lighting arrangement cyclically emits a lighting sequence in the lighting area. The lighting sequence has at least four lighting pulses each of which have a wavelength range and a lighting direction. At least three of the at least four lighting pulses have a different wavelength range, and at least two of the at least four lighting pulses have a different lighting direction and a same wavelength range.

A bicycle system with omnidirectional viewing having front-facing, stereoscopic video camera devices relying on computer vision. The front-facing, stereoscopic video camera devices positioned on the bicycle help identify, classify, and recommend a safe trajectory around obstacles in real-time using augmented reality. The bicycle system details safety-related and guidance-related information.

An endoscope with an optical channel is held and positioned by a robotic surgical system. A capture unit captures (1) a visible first image at a first time and (2) a visible second image combined with a fluorescence image at a second time. An image processing system receives (1) the visible first image and (2) the visible second image combined with the fluorescence image and generates at least one fluorescence image. A display system outputs an output image including an artificial fluorescence image.

A method for determining the complex amplitude of the electromagnetic field associated with a scene, comprising a) capturing a plurality of images of the scene by means of a photographic camera, the images being focused in planes of focus arranged at different distances, wherein the camera comprises a lens of focal length F and a sensor arranged at a certain distance from the lens in its image space, taking at least one image pair from the plurality of images and determining the accumulated wavefront to the conjugate plane in the object space corresponding to the intermediate plane with respect to the planes of focus of the two images of the pair.

There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform controlling a delivery of a video conference call to a viewport, setting a timer and an event-based threshold with respect to the video conference call, determining whether any of the timer and the event-based threshold have been triggered based on any of an elapsed time and an event, and further controlling the delivery of the video conference call to the viewport based on determining whether any of the timer and the event-based threshold have been triggered.

There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform controlling a delivery of a video conference call to a viewport, setting a timer and an event-based threshold with respect to the video conference call, determining whether any of the timer and the event-based threshold have been triggered based on any of an elapsed time and an event, and further controlling the delivery of the video conference call to the viewport based on determining whether any of the timer and the event-based threshold have been triggered.

This patent provides a method and apparatus for acquiring imagery with improve spatial resolution through an apparatus called a “light painting imaging device”. Other aspects of this invention correct for barrel distortion and pincushion distortion.

This patent provides a method and apparatus for acquiring imagery with improve spatial resolution through an apparatus called a “light painting imaging device”. Other aspects of this invention correct for barrel distortion and pincushion distortion.