Multiple images may be combined to obtain a composite image. Individual images may be obtained with different camera sensors and/or at different time instances. In order to obtain the composite image source images may be aligned in order to produce a seamless stitch. Source images may be characterized by a region of overlap. A disparity measure may be determined for pixels along a border region between the source images. A warp transformation may be determined using an optimizing process configured to determine displacement of pixels of the border region based on the disparity. Pixel displacement at a given location may be constrained to direction configured tangential to an epipolar line corresponding to the location. The warp transformation may be propagated to pixels of the image. Spatial and/or temporal smoothing may be applied. In order to obtain optimized solution, the warp transformation may be determined at multiple spatial scales.

In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.

Examples are described for overlaying circular images onto a three-dimensional mesh model to generated respective portions of image content for 360-degree viewable content, where each of the portions is a sub-capsule that is larger than half of the sphere. The portions are rendered and then blended based on overlapping portions of the image content from the 360-degree viewable content.

An accurate subject distance can be calculated on the basis of a camera captured image even in a case where the attachment angle of a camera is deviated. An image captured with a camera having a wide-angle lens is input to perform distortion correction and generate a corrected image. Moreover, the inclination of a vertical object in the real world in the corrected image is calculated. The deviation angle of the camera depression angle of the camera is calculated on the basis of the inclination of the vertical object. An object distance calculation image is generated in consideration of the camera depression angle deviation angle. The distance of an object included in the camera captured image is calculated from the object distance calculation image. In a case where the camera depression angle deviation angle is not equal to or less than a prespecified threshold, the object distance calculation image is generated by using overhead image generation mapping data in consideration of the camera depression angle deviation.

An image processing apparatus is disclosed. The image processing apparatus includes a storage unit; a transceiver; and a processor for controlling the storage unit to store an input frame including a plurality of image areas having preset arrangement attributes and metadata including the preset arrangement attributes, control the transceiver to receive viewing angle information, and control the transceiver to transmit the metadata and image data of at least one image region corresponding to the viewing angle information among the plurality of image regions by using at least one of the plurality of transmission channels matched with the plurality of image regions.

It is possible to easily reproduce and edit image data that is a moving image obtained by capturing an image of a non-central projection method, in which distortion correction and blur correction are reflected. For this purpose, an information processing apparatus includes: a distortion correction processing unit that performs distortion correction processing for converting image data as a moving image acquired by capturing an image of a non-central projection method into an image of a central projection method; and a blur correction processing unit that performs blur correction processing of reducing the image blur generated in the image data using posture data of an imaging apparatus for image data that has been subjected to the distortion correction processing. In other words, the blur correction is performed after the distortion correction.

This specification describes technologies relating to digital images. In general, one aspect of the subject matter described in this specification can be embodied in methods that include the actions of receiving a source wide-angle image; identifying one or more locally salient features of the source wide-angle image; calculating a mapping from the source wide-angle image to a two-dimensional mapped wide-angle image according to constraints using the identified one or more spatially variable salient features; and rendering the mapped wide-angle image using the calculated mapping such that the mapped wide-angle image reduces distortion of the locally salient features relative to the distortion of the source wide angle image.

A method including streaming input image data representing an input frame of a video into temporary storage. Transformation data representing at least one transformation for application to the input image data is obtained. Ordering data indicating a variable order in which portions of output image data are to be generated is obtained, the ordering data being based on at least one characteristic of the input frame. The transformation data is used to identify portions of input image data to be processed to generate corresponding portions of output image data. The identified portions of input image data are processed to generate the corresponding portions of output image data in the order indicated by the ordering data.

An image sensor including: a pixel array including pixels each pixel including a photoelectric conversion element, a transmission transistor to transmit photocharges generated by the photoelectric conversion element to a floating diffusion node, and a reset transistor to reset the floating diffusion node based on a pixel power voltage; and a row driver to control the pixels, wherein the row driver includes a transmission control signal generator to provide a transmission control signal to the transmission transistor, wherein the transmission control signal generator includes: a first transistor to which a first voltage is applied; a second transistor connected to the first transistor; a third transistor to which a second voltage is applied, the second voltage being higher than the first voltage; and a fourth transistor connected to the third transistor, wherein an ON resistance of the second transistor is different from an ON resistance of the first transistor.

The invention relates to a method of 3D reconstruction of a scene by means of 2D panoramic images of the scene, which comprises a step of processing these images. These images arise from a panoramic system moving in displacement along a determined trajectory, such that the image of at least one point of the scene is in at least 3 successive images obtained according to various directions; the step of processing these 2D successive images comprises the sub-steps: a) determining reconstruction planes in the scene to be reconstructed, b) determining, on the basis of pairs of panoramic images and for each pair, rectification planes corresponding to the reconstruction planes and projecting onto each of them a sector of each image of the pair, in a direct manner, so as to obtain two 2D rectified images, c) matching the two 2D rectified images so as to obtain an intermediate 3D reconstruction, d) transforming each intermediate 3D reconstruction into a 3D frame including the reconstruction planes so as to obtain a transformed intermediate 3D reconstruction, e) repeating steps b) to d) on the basis of a new pair of 2D panoramic images and of at least one other rectification plane, so as to obtain at least one other transformed intermediate 3D reconstruction, f) temporally fusing at least two transformed intermediate 3D reconstructions so as to obtain a 3D reconstruction of the scene.