A method of transmitting omnidirectional video is provided according to one aspect of the present invention. The method of transmitting omnidirectional video according to an embodiment of the present invention includes: acquiring an image for the omnidirectional video; projecting the image for the omnidirectional video onto a 3D projection structure; packing the image projected on the 3D projection structure into a 2D frame; encoding the image packed into the 2D frame; and transmitting a data signal including the encoded image and metadata about the omnidirectional video.

This disclosure provides an apparatus and method for performing object detection based on images captured by a fisheye camera and an electronic device. The apparatus includes a memory and a processor coupled to the memory. The processor according to an embodiment is configured to: project an original image captured by the fisheye camera onto a cylindrical or spherical projection model, and perform reverse mapping to obtain at least two reversely mapped images, angles of view of the at least two reversely mapped images being towards different directions, detect objects in the reversely mapped images, respectively, and detect an object that is the same among the objects detected in the reversely mapped images. According to this disclosure, information in the wide field of view images obtained by capturing by the fisheye camera may be fully utilized.

Even if a generated wide-field image includes residual local misalignment, this charged particle microscope device can prompt for user input to correct such local misalignment, and can regenerate, on the basis of the user input, a wide-field image that includes little misalignment even in local areas of the overlap regions thereof. A charged particle microscope according to the present invention captures a plurality of images in such a way that each captured image has overlap regions that are to be overlapped with the overlap regions of captured images adjacent to that captured image, wherein an image processing unit: sets a pair of corresponding points in respective overlap regions of each two adjacent captured images; sets predetermined constraint conditions for each captured image; calculates the amounts of misalignment between the plurality of captured images on the basis of the set pairs of corresponding points and the set constraint conditions; connects the plurality of captured images to one another after correcting the misalignment between these captured images on the basis of the calculated amounts of misalignment, thereby generating a single wide-field image; calculates, for each of a plurality of local areas set in the overlap regions of each two adjacent captured images, a degree of reliability for the connection between these captured images; and notifies a user of either each found low reliability local area or the overlap region including that low reliability local area, as well as the set pairs of corresponding points and the set constraint conditions.

Techniques related to calibrating fisheye cameras using a single image are discussed. Such techniques include applying a first pretrained convolutional neural network to an input fisheye image to generate camera model parameters excluding a principle point and applying a second pretrained convolutional neural network to the fisheye image and a difference of the fisheye image and a projection of the fisheye image using the camera model parameters to generate the principle point.

An image processing system is provided that includes an image capturing apparatus configured to generate a plurality of captured images and at least one information processing apparatus connected to the image capturing apparatus. The information processing apparatus includes processing circuitry configured to input at least a first captured image and a second captured image from among the plurality of captured images, acquire first conversion data to be used for converting the first captured image and second conversion data to be used for converting the second captured image, and generate an output image by stitching converted images generated by converting the first captured image based on the first conversion data and the second captured image based on the second conversion data.

Systems, methods, and instrumentalities may be provided for discounting reconstructed samples and/or coding information from spatial neighbors across face discontinuities. Whether a current block is located at a face discontinuity may be determined. The face discontinuity may be a face boundary between two or more adjoining blocks that are not spherical neighbors. The coding availability of a neighboring block of the current block may be determined, e.g., based on whether the neighboring block is on the same side of the face discontinuity as the current block. For example, the neighboring block may be determined to be available for decoding the current block if it is on the same side of the face discontinuity as the current block, and unavailable if it Is not on the same side of the face discontinuity. The neighboring block may be a spatial neighboring block or a temporal neighboring block.

The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. The mobile image capture device is operable to input an image into at least one neural network and to receive at least one descriptor of the desirability of a scene depicted by the image as an output of the at least one neural network. The mobile image capture device is operable to determine, based at least in part on the at least one descriptor of the desirability of the scene of the image, whether to store a second copy of such image and/or one or more contemporaneously captured images in a non-volatile memory of the mobile image capture device or to discard a first copy of such image from a temporary image buffer without storing the second copy of such image in the non-volatile memory.

A surround view monitor apparatus includes two imaging devices mounted on a first vehicle section of an articulated vehicle to capture two respective images that include, within fields of view thereof, areas of view looking in a direction of a road surface area occupied by a second vehicle section in an unbent state, a control unit configured to select one of the two images as an image to be displayed on the road surface area in response to a bending angle between the first vehicle section and the second vehicle section, and configured to combine the two images to generate a synthesized image showing surroundings of the articulated vehicle, and a display monitor configured to display the synthesized image.

A method displays information graphically on an image captured by a vehicular optical system. The method includes capturing the image and identifying an object in the image. The method the assigns a priority level to the object based on a predetermined criterion. The object is altered based on its priority level to create an altered object. An altered object may have a changed color, a colored halo surrounding it, or a colored object inside it. Other possible ways to alter the way the object looks are possible. The altered object is displayed in the image in place of the object on a mobile device to alert a person of its presence and the priority level associated therewith.

[Object] To obtain a more useful image when an image including a 360 view around the camera is used without being remapped. [Solution] Provided is an image processing device including: an image acquisition unit that acquires a 360 image; and a rotational angle computation unit that computes a rotational angle of the 360 image in a manner that a reference point included in the 360 image is positioned in a designated orientation with respect to a center of the 360 image.