Panoramic videos are generated from multiple video feeds in real time received from multiple video cameras, such as an array of video cameras having overlapping fields of view. Texture mapping techniques are employed to correct lens distortion or other defects or deficiencies in the video frames in each of the video feeds caused by optical properties of the corresponding video camera. Video frames of related video feeds, such as the video feeds of cameras in an array of cameras having adjacent and overlapping fields of view, are seamlessly stitched automatically based on an initial manual configuration, again employing texture mapping techniques. A colour profile of the different video frames is normalized to provide a uniform and seamless colour profile of the video panoramic view.

There is provided a method performed in a multi-sensor video camera having a first and a second sensor with partly overlapping fields of view. A first and a second received video frame being simultaneously captured each has a non-overlapping portion and an overlapping portion. A frame of a first video stream is generated by joining together image data from the non-overlapping portions of the first and the second video frame with image data from the overlapping portion of the first video frame only, and a frame of a second video stream is generated to include image data from the overlapping portion of at least the second video frame. The frame of the first video stream and the frame of the second video stream are processed in parallel, wherein the processing of the frame of the second video stream includes preparing an overlay based on the image data from the overlapping portion of at least the second video frame. The overlay is added to the processed frame of the first video stream at a portion thereof corresponding to the overlapping portion of the first video frame. Image data from the overlapping portion of the first video frame is blended with image data from the overlapping portion of the second video frame in at least one of the steps of preparing the overlay and adding the overlay.

The present invention provides a method for Spherical Camera Image Stitching. By using two fisheye lens to catch two fisheye images and then being developed into three pairs of flat figures based on Segmented Sphere Projection (SSP) method. Thereafter each corresponding pair is stitched based on a similar-edge method, and then three pairs are combined to form a panoramic image. At the end, the combined panoramic image is projected to a 3-D ball sphere space.

An imaging apparatus includes an imaging unit, a first image processor, and a second image processor. The imaging unit sequentially acquires image frames whose photography conditions have been changed. The first image processor generates moving image data by performing image processing to maintain continuity between the image frames obtained by changing the photography conditions. The second image processor composes the image frames whose photography conditions have been changed, to generate condition-changed still image data.

Provided is a parallax minimization stitching method and apparatus using control points in an overlapping region. A parallax minimization stitching method may include defining a plurality of control points in an overlapping region of a first image and a second image received from a plurality of cameras, performing a first geometric correction by applying a homography to the control points, defining a plurality of patches based on the control points, and performing a second geometric correction by mapping the patches.

An image processing device is provided. The image processing devices includes an input part configured to input an input image; a cutout part configured to cut out a plurality of image regions from the input image input by the input part; and a luminance change part configured to execute luminance change of each of the image regions cut out by the cutout part.

To improve user operability.

Provided is a Next change operating section that receives a changing operation on each item in a Next control data set being in a control state of a Next-use M/E of a switcher (vision mixer). When a changing operation is received in the Next change operating section, that is, when there is a changing operation, a control section changes contents of the Next control data set, and in accordance with the changed contents of the Next control data set, sends a control signal concerning the Next-use M/E to the switcher. A user can simply and easily change the contents of the Next control data set by operating the Next change operating section, and operability can be improved.

The luminance atmosphere that the creator intends is excellently reproduced on the receiving end. The transmission video data is obtained by applying a predetermined opto-electrical transfer function to the input video data. The transmission video data is transmitted together with the luminance conversion acceptable range information about a set region in the screen. For example, a transmitting unit transmits a video stream obtained by encoding the transmission video data while inserting the luminance conversion acceptable range information into a layer of the video stream. The receiving end obtains display video data by applying an electro-optical transfer function corresponding to the predetermined opto-electrical transfer function to the transmission video data, and performing a luminance conversion process in each of the set regions independently in accordance with the luminance conversion acceptable range information.

An image-pickup apparatus including: an image-pickup unit configured to capture an image of surroundings of a vehicle; a controller configured to control the image-pickup unit; an image processor configured to process image data output from the image-pickup unit; an output unit configured to output the image processed by the image processor to a display unit; and a detection unit configured to detect information regarding a course change of the vehicle, in which at least one of the image-pickup control performed by the controller and the image processing performed by the image processor applies weighting such that the weighting becomes larger in a course change direction based on the information regarding the course change detected by the detection unit is provided. Accordingly, it is possible to present images that enable the driver to appropriately check the state of the lane after the course change during the course change.

The luminance atmosphere that the creator intends is excellently reproduced on the receiving end. The transmission video data is obtained by applying a predetermined opto-electrical transfer function to the input video data. The transmission video data is transmitted together with the luminance conversion acceptable range information about a set region in the screen. For example, a transmitting unit transmits a video stream obtained by encoding the transmission video data while inserting the luminance conversion acceptable range information into a layer of the video stream. The receiving end obtains display video data by applying an electro-optical transfer function corresponding to the predetermined opto-electrical transfer function to the transmission video data, and performing a luminance conversion process in each of the set regions independently in accordance with the luminance conversion acceptable range information.