G06T3/0062

Method and apparatus for processing 360-degree image

A communication technique for merging, with an IoT technology, a 5G communication system for supporting a data transmission rate higher than that of a 4G system is provided. The communication technique can be applied to an intelligent service (for example, smart home, smart building, smart city, smart car or connected car, health care, digital education, retail business, and security and safety-related services, and the like) on the basis of a 5G communication technology and an IoT-related technology. A method for processing a 360-degree image is provided. The method includes determining a three-dimensional (3D) model for mapping a 360-degree image; determining a partition size for the 360-degree image; determining a rotational angle for each of the x, y, and z axes of the 360-degree image; determining an interpolation method to be applied when mapping the 360-degree image to a two-dimensional (2D) image; and converting the 360-degree image into the 2D image.

PROJECTION OF 3D IMAGE DATA ONTO A FLAT SURFACE
20230092974 · 2023-03-23 · ·

In a method for transformation of a 3D representation of a part of a body, a central axis of the part of the body to be represented is defined, and a transformation surface that is axis-symmetrical to the central axis is defined. The transformation surface is transformed into a plane and a transformation of the voxels representing the part of the body oriented to the transformed transformation surface is carried out.

GENERATING EQUIRECTANGULAR IMAGERY OF A 3D VIRTUAL ENVIRONMENT
20220343595 · 2022-10-27 ·

Examples are disclosed that relate to generating an equirectangular image of a three-dimensional (3D) virtual environment in a computer-automated fashion. In one example, a 3D virtual position of a virtual camera in a 3D virtual environment is specified. For each of a plurality of different yaw angles rotated about an axis extending through the 3D virtual position, the virtual camera is used to acquire an image strip of pixels parallel to the axis of rotation. Image strips of pixels of the 3D environment acquired at the different yaw angles are assembled to form an equirectangular image of the 3D virtual environment from the specified 3D virtual position.

SYSTEMS AND METHODS FOR GENERATING PANORAMIC VISUAL CONTENT
20230077880 · 2023-03-16 ·

An image or a video may include a spherical capture of a scene. A punchout of the image or the video may be generated by placement of a viewing window at a center of a two-dimensional plane onto which the image or the video is mapped. The punchout of the image or the video may provide a panoramic view of the scene.

OBSTACLE DETECTION DEVICE
20230079994 · 2023-03-16 ·

An obstacle detecting device includes: an image converting portion for converting, into a circular cylindrical image, an image captured by a camera installed on a vehicle; a detection subject candidate image detecting portion for detecting a detection subject candidate image through pattern matching; an optical flow calculating portion for calculating an optical flow; an outlier removing portion for removing an optical flow that is not a detection subject; a TTC calculating portion for calculating a TTC (TTCX, TTCY); a tracking portion for generating a region of the detection subject on the circular cylindrical image by tracking the detection subject candidate; and a collision evaluating portion for evaluating whether or not there is the risk of a collision, wherein the optical flow calculating portion calculates the optical flow based on the detection subject candidate image and the region.

Image data encoding/decoding method and apparatus

Disclosed is an image data encoding/decoding method and apparatus. A method for decoding a 360-degree image comprises the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format.

Surround-view with seamless transition to 3D view system and method

A method for seamless transition from a 2D surround view to a 3D surround view. The method includes initializing the 2D-SRV processing chain, displaying the 2D surround view while waiting for HLOS handshake to complete and upon completion of a HLOS handshake, initializing a 3D-SRV processing chain and waiting for a 3D-SRV buffer output; disabling the 2D-SRV display pipeline and enabling a 3D-SRV display pipeline; enabling switchback monitor; atomically switching to 3D surround view seamlessly and glitch free; and displaying 3D surround view on a monitor. Another method includes detecting a crash in a HLOS and seamlessly switching to a 2D surround view from a 3D surround view.

Fast Distortion Correction for Wide Field of View (FOV) Cameras
20220335579 · 2022-10-20 ·

Devices, methods, and non-transitory program storage devices are disclosed herein to provide for improved perspective distortion correction for wide field of view (FOV) video image streams. The techniques disclosed herein may be configured, such that the distortion correction applied to requested region of interest (ROI) portions taken from individual images of the wide FOV video image stream smoothly transitions between applying different distortion correction to ROIs, depending on their respective FOVs. In particular, the techniques disclosed herein may modify the types and/or amounts of perspective distortion correction applied, based on the FOVs of the ROIs, as well as their location within the original wide FOV video image stream. In some cases, additional perspective distortion correction may also be applied to account for tilt in an image capture device as the wide FOV video image stream is being captured and/or the unwanted inclusion of “invalid” pixels from the wide FOV image.

SYSTEMS AND METHODS FOR DETECTING OBJECTS WITHIN AN IMAGE IN A WIDE-VIEW FORMAT
20230077082 · 2023-03-09 ·

System, methods, and other embodiments detecting and localizing objects within an image in a wide-view format using a synthetic representation. The method includes converting a real image in a wide-view format to a synthetic representation using a style model, wherein the synthetic representation depicts a distorted view of an object. The method also includes identifying features of the object using an extraction model that distinguishes different scales of the synthetic representation and a simulated scene to define structures associated with the distorted view. The method also includes detecting the object using a decoder model that identifies an attribute and a bounding box of the object from the features. The method also includes executing a task using the attribute and the bounding box to localize the object in the simulated scene.

Apparatus and methods for the optimal stitch zone calculation of a generated projection of a spherical image

Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.