A head mounted display (HMD) identifies viewing trends for a video based on multiple viewings of the video by users having different user characteristics. The analysis identifies viewing trends based on user characteristics, e.g., the age and gender of the user. When a subsequent user is viewing the video, a production & post production module receives the user's profile information and identifies the predicted viewing location of the user at particular times during the video using the identified trends based on where previous users/viewers, who have a profile or characteristics similar to the user, were looking at the particular times during the video. The production & post production module identifies the center tile as the predicted viewing location at a particular time for the user and prepares and encodes the video stream based on the predicted viewing location and, for example, streams the video to the HMD in which the predicted viewing location is the center tile at the associated time in the video. This can increase the effectiveness of the data transmitted to the HUD.

The invention relates to a raw image encoder for encoding a raw image of a predetermined color pattern according to which the raw image is partitioned into pixel cell blocks, each pixel cell block comprising four pixels, each pixel being associated with one of three base colors so that each pixel cell block comprises, for each of the three base colors, at least one pixel, the raw image encoder configured to subject the raw image to a color transformation to obtain a color image, by mapping, for each pixel cell block, the four pixels of the pixel cell block onto a color component quadruple forming a sample of the color image, the color component quadruple comprising three color component values of a target color space, and one pseudo color component value, and subject the color image to a multi-component picture encoding to obtain a compressed data stream.

Video frames of a higher-resolution chroma sampling format such as YUV 4:4:4 are packed into video frames of a lower-resolution chroma sampling format such as YUV 4:2:0 for purposes of video encoding. For example, sample values for a frame in YUV 4:4:4 format are packed into two frames in YUV 4:2:0 format. After decoding, the video frames of the lower-resolution chroma sampling format can be unpacked to reconstruct the video frames of the higher-resolution chroma sampling format. In this way, available encoders and decoders operating at the lower-resolution chroma sampling format can be used, while still retaining higher resolution chroma information. In example implementations, frames in YUV 4:4:4 format are packed into frames in YUV 4:2:0 format such that geometric correspondence is maintained between Y, U and V components for the frames in YUV 4:2:0 format.

The present application provides an image processing method, an image processing apparatus, an electronic device and a computer-readable storage medium, and relates to the field of image processing technologies. An implementation includes: acquiring an image to be processed; converting the image to be processed into a three-channel YUV image; performing a convolution operation on a Y-channel image, a U-channel image and a V-channel image in the three-channel YUV image to generate an R-channel image, a G-channel image and a B-channel image, respectively, and acquiring a three-channel RGB image; and pre-processing the three-channel RGB image. According to the present application, the image pre-processing speed can be improved.

An image processing apparatus acquires a color image including a plurality of primary color signals, performs color space conversion processing on the color image to generate a brightness signal image and a color difference signal image, performs super-resolution processing on the brightness signal image and the color difference signal image to generate a prediction brightness signal image, and uses the prediction brightness signal image to generate a super-resolution color image in which a resolution of the color image is increased.

An image processing device includes a memory and a processor configured to separate first image data obtained by an image sensor having a Bayer arrangement, into second image data that includes brightness information, and third image data that includes color information and has a lower resolution than the first image data and the second image data, wherein a pixel arrangement of the third image data includes two pixels in each of a horizontal direction and a vertical direction, among which two pixels on one diagonal are of a same type, two pixels on another diagonal are of types different from each other, and the two pixels on said another diagonal are of the types different from the two pixels on the one diagonal.

An image processing method includes receiving an image frame, retrieving luminance information and chrominance information from the image frame, respectively, encoding the luminance information to generate an encoded luminance frame, encoding the chrominance information to generate an encoded chrominance frame, writing the encoded luminance frame to a first memory portion of a memory, and writing the encoded chrominance frame to a second memory portion of the memory. The image processing method further includes reading the encoded luminance frame from the first memory portion and decoding the encoded luminance frame to generate decoded luminance information, and reading the encoded chrominance frame from the second memory portion and decoding the encoded chrominance frame to generate decoded chrominance information.

A method may include: receiving facial image of the patient that depicts the patient's teeth; receiving a 3D model of the patient's teeth; determining color palette of the depiction of the patient's teeth; coding 3D model of the patient's teeth based on attributes of the 3D model; providing the 3D model, the color palette, and the coded 3D model to a neural network; processing the 3D model, the color palette, and the coded 3D model by the neural network to generate a processed image of the patient's teeth; simulating specular highlights on the processed image of the patient's teeth; and inserting the processed image of the patient's teeth into a mouth opening of the facial image.

There is provided a signal processor including correction circuitry configured to correct a signal for each color input to the signal processor and to output the corrected signal for each color, first conversion circuitry configured to receive the corrected signal for each color, to perform first image processing on each corrected signal for each color, and to generate a first signal having a first color gamut for each color, second conversion circuitry configured to receive the corrected signal for each color, to perform second image processing on each corrected signal for each color, and to generate a second signal having a second color gamut for each color, where the signal processor outputs a first image data having a first color gamut and a second image data having a second color gamut from same corrected signals for each color.

A production system determines which areas or portions of a video file (e.g., for a scene) are static and which areas contain motion. Instead of steaming redundant image data for the static areas of the video, the production only sends image data for or updates the areas of each frame that contain motion to minimize an amount of data being streamed to a head mounted display (HMD) without compromising image quality.