Provided are methods for active alignment of an optical assembly with intrinsic calibration. Some methods described include performing a first active alignment using a multi-collimator assembly, determining a principal point of the camera assembly using a diffractive optical element (DOE) intrinsic calibration module, and adjusting the relative position of one or more of the lens and the image sensor to align the principal point of the camera assembly with an image center of the image sensor and to perform a second active alignment. Systems and computer program products are also provided.

Techniques for aligning images generated by an integrated camera physically mounted to an HMD with images generated by a detached camera physically unmounted from the HMD are disclosed. A 3D feature map is generated and shared with the detached camera. Both the integrated camera and the detached camera use the 3D feature map to relocalize themselves and to determine their respective 6 DOF poses. The HMD receives the detached camera's image of the environment and the 6 DOF pose of the detached camera. A depth map of the environment is accessed. An overlaid image is generated by reprojecting a perspective of the detached camera's image to align with a perspective of the integrated camera and by overlaying the reprojected detached camera's image onto the integrated camera's image.

Augmented reality systems provide graphics over views from a mobile device for both in-venue and remote viewing of a sporting or other event. A server system can provide a transformation between the coordinate system of a mobile device (smart phone, tablet computer, head mounted display) and a real world coordinate system. Requested graphics for the event are displayed over a view of an event.

Disclosed is a method including receiving a depth map estimated using data based on image and data received from a movement sensor as input, generating an alignment parameter based on the depth map, adding the alignment parameter to a pre-calibration state to define a user operational calibration state, generating scale parameters and shift parameters based on features associated with the data received from the image and movement sensor, and calibrating the image and movement sensor based on the user operational calibration state, the scale parameters and the shift parameters.

A CPU acquires a distance image or a visible light image obtained by imaging a marker for measuring an SID as an object to be imaged using a TOF camera or a visible light camera. In addition, the CPU derives a marker distance between the TOF camera or the visible light camera and the marker from an image of a marker region corresponding to the marker in the acquired distance image or visible light image. Further, the CPU derives the SID on the basis of the derived marker distance and information indicating a positional relationship between an acquisition unit and the marker.

A shooting method executed by a shooting device includes: shooting first images of a target space; generating a first three-dimensional point cloud of the target space, based on the first images and a first shooting position and a first shooting orientation of each of the first images; and determining a first region of the target space for which generating a second three-dimensional point cloud which is denser than the first three-dimensional point cloud is difficult, using the first three-dimensional point cloud and without generating the second three-dimensional point cloud. The determining includes generating a mesh using the first three-dimensional point cloud, and determining the region other than a second region of the target space for which the mesh is generated.

A visual positioning method and apparatus, an electronic device, a computer readable storage medium, and a computer program product are provided. The method includes: performing contour enhancement processing on an actual building image included in a image for positioning to obtain an actual building contour, and determining location information of a target building matching the actual building contour from a preset contour map, the contour map being obtained by blurring non-building contour information in a real panoramic map, and finally generating a visual positioning result based on the location information.

Registration of a surgical image acquisition device (e.g. an endoscope) using preoperative and live contour signatures of an anatomical object is described. A control unit includes a processor configured to compare the real-time contour signature to the database of preoperative contour signatures of the anatomical object to generate a group of potential contour signature matches for selection of a final contour match. Registration of an image acquisition device to the surgical site is realized based upon an orientation corresponding to the selected final contour signature match.

A vision-assist device may include at least one image sensor for generating image data corresponding to an environment, a user input device for receiving user input regarding one or more physical characteristics of a user, and a processor. The processor may be programmed to receive the image data from the at least one image sensor, receive the user input from the user input device, and adjust an alignment of the at least one image sensor based on the received image data and the user input. Methods for aligning an image sensor are also provided.

A system and method for localizing an autonomous vehicle using a digital stereo camera mounted to the autonomous vehicle and oriented to obtain images of the road surface. The system comprises an image processor configured to analyze the images of the road surface and identify micro-features, such as pores, holes, cracks, and granular material embedded in the street. The image processor is configured to compile previously obtained images of the road surface into reference mosaics and to compare the micro-features identified in newly obtained images to the reference mosaic to determine the location of the autonomous vehicle. The system may be further configured with a communications module to transmit images and localization information to a database repository or server.