A calibration method for linking spherical coordinates to texture coordinates is provided. The method comprises: installing a plurality of lamps forming a horizontal semicircle arc and a rotation equipment located at its circle center; mounting a N-lens camera on the rotation equipment; causing the N-lens camera to spin about a spin axis passing through two ends of the horizontal semicircle arc and capture a plurality of lens images for different spin angles by the rotation equipment; and, determining longitude and latitude coordinates of a plurality of calibration points according to the different spin angles and the texture coordinates of the calibration points in the lens images to create a link between the spherical coordinates and the texture coordinates. Different positions of the lamps respectively represent different latitudes and different spin angles respectively represent different longitudes. Heights of the camera and the lamps are the same.

A method is shown to indicate to a driver of a vehicle the presence of an object moving relative to the vehicle. The method begins by collecting data using a camera or other such image capturing device. The data is analyzed to detect a hazard created by the presence of the object, regardless of whether it is moving or not. A warning associated with the hazard is created. Both the hazard and the warning are displayed using the display device.

A system for creating synthetic data for testing an autonomous system, comprising at least one hardware processor adapted to execute a code for: using a machine learning model to compute a plurality of depth maps based on a plurality of real signals captured simultaneously from a common physical scene, each of the plurality of real signals are captured by one of a plurality of sensors, each of the plurality of computed depth maps qualifies one of the plurality of real signals; applying a point of view transformation to the plurality of real signals and the plurality of depth maps, to produce synthetic data simulating a possible signal captured from the common physical scene by a target sensor in an identified position relative to the plurality of sensors; and providing the synthetic data to at least one testing engine to test an autonomous system comprising the target sensor.

An image processing apparatus includes circuitry to: obtain a wide-angle image, the wide-angle image being a part of or entire captured image of an object; convert the wide-angle image into a wide-angle image having a first image definition; obtain a part of the wide-angle image as a narrow-angle image; and apply projection transformation to the narrow-angle image to generate a narrow-angle image having a projection different than a projection of the wide-angle image, the narrow-angle image having a second image definition different than the first image definition of the wide-angle image.

An apparatus includes an interface and a processor. The interface may be configured to receive video frames corresponding to an exterior view of a vehicle generated by a plurality of capture devices. The processor may be configured to perform digital warping on the video frames, generate distorted video frames in response to the digital warping, perform video stitching operations on the distorted video frames and generate panoramic video frames in response to the video stitching operations. The digital warping may be performed to adjust the video frames based on lens characteristics of the capture devices. An amount of the digital warping applied may be selected to provide a size continuity of objects in the distorted video frames at a stitching seam in the panoramic video frames. The panoramic video frames may be generated to fit a size of a display.

Various technologies described herein pertain to rectification of a fisheye image. A computing system receives the fisheye image. Responsive to receiving the fisheye image, the computing system applies a first lookup function to a first portion of the fisheye image to mitigate spatial distortions of the fisheye image. The computing system also applies a second lookup function to a second portion of the fisheye image to mitigate the spatial distortions. The first lookup function maps first pixels in the first portion to a first rectilinear image corresponding to the first portion when viewed from a first perspective of a first virtual camera. The second lookup function maps second pixels in the second portion to a second rectilinear image corresponding to the second portion when viewed from a second perspective of a second virtual camera. The computing system then outputs the first rectilinear image and the second rectilinear image.

Technologies for utilizing a bowl-shaped image include a computing device to receive a first fisheye image capturing a first scene and a second fisheye image capturing a second scene overlapping with the first scene at an overlapping region. The computing device generates a combined image of the first fisheye image and the second fisheye image, performs object classification on a region of interest of at least one of the first fisheye image or the second fisheye image to classify an object within the region of interest, and generates a portion of a bowl-shaped image based on the combined image.

An image processing method and apparatus are provided. The image processing apparatus includes an interface configured to output an input frame and metadata including type information and subtype information; and a rendering unit configured to: determine a type of a polyhedron included in an output frame based on the type information, determine attributes of arrangement of a plurality of areas included in the input frame based on the subtype information, and render the output frame by mapping each of the plurality of areas to corresponding faces of the polyhedron, based on the attributes of arrangement of the plurality of areas.

A method of transmitting omnidirectional video is provided according to one aspect of the present invention. The method of transmitting omnidirectional video according to an embodiment of the present invention includes: acquiring an image for the omnidirectional video; projecting the image for the omnidirectional video onto a 3D projection structure; packing the image projected on the 3D projection structure into a 2D frame; encoding the image packed into the 2D frame; and transmitting a data signal including the encoded image and metadata about the omnidirectional video.

A method for outputting a video frame is disclosed, and the method includes: acquiring video images from multiple view angles; fusing and stitching, according to view angle information provided by a user terminal, video images of corresponding view angles to form a local video frame matching the view angle information; and providing the local video frame to the user terminal.