A method and an apparatus for generating a virtual viewpoint image by obtaining at least one input viewpoint image and warping pixels of the at least one input viewpoint image to a virtual viewpoint image coordinate system; mapping a patch to a first pixel of a plurality of pixels warped to the virtual viewpoint image coordinate system when a difference between a first depth value of the first pixel and a second depth value of a second pixel adjacent to the first pixel is less than or equal to a predetermined threshold and mapping no patch to the first pixel when the difference is greater than the predetermined threshold; and generating the virtual viewpoint image by blending the plurality of pixels and/or the patch are provided.

A method of depth detection based on a plurality of video frames includes receiving a plurality of input frames including a first input frame, a second input frame, and a third input frame respectively corresponding to different capture times, convolving the first to third input frames to generate a first feature map, a second feature map, and a third feature map corresponding to the different capture times, calculating a temporal attention map based on the first to third feature maps, the temporal attention map including a plurality of weights corresponding to different pairs of feature maps from among the first to third feature maps, each weight of the plurality of weights indicating a similarity level of a corresponding pair of feature maps, and applying the temporal attention map to the first to third feature maps to generate a feature map with temporal attention.

A medical apparatus includes a registration tool, which includes a position sensor, A position-tracking system is configured to acquire position coordinates of the sensor in a first frame of reference defined by the position-tracking system. A processing unit is configured to receive 3D image data with respect to the body of the patient in a second frame of reference, to generate a 2D image of the surface of the patient based on the 3D image data, to render the 2D image to a display screen, and to superimpose onto the 2D image icons indicating locations of respective landmarks. The processing unit receives the position coordinates acquired by the position-tracking system while the registration tool contacts the locations on the patient corresponding to the icons on the display, and registers the first and second frames of reference by comparing the position coordinates to the three-dimensional image data.

A system and method for processing an input video while maintaining temporal consistency across video frames is provided. The method includes converting the input video from a first frame rate to a second frame rate, wherein the second frame rate is a faster frame rate than the first frame rate; generating processed frames of the input video at the second frame rate; and aggregating the processed frames using temporal sliding window aggregation to yield a processed output video at a third frame rate.

An image processing method includes the steps of lighting up at least a part of light emitting units of a light emitting device; capturing a plurality of detection images corresponding to a plurality of sections of the light emitting device respectively, wherein each section includes a plurality of lighted-up light emitting units, each detection image includes a plurality of light spots respectively corresponding to the light emitting units of the associated section, and every two adjacent sections have an overlap area including at least one lighted-up light emitting unit; and stitching the detection images of the adjacent sections together by taking the light spots corresponding to at least one lighted-up light emitting unit of the overlap area as alignment reference spots, so that the light emitting statuses of all the light emitting units are presented by a single image.

An image distortion correction circuit performs a distortion correction process on an image signal on the basis of distortion correction data to generate a distortion-corrected image signal. The distortion correction data is for correcting coordinate positions of display data fragments corresponding to respective N coordinate positions in the display image to first to N-th distortion correction coordinate positions. The image distortion correction circuit determines a distortion correction coordinate position where abnormality occurs as an abnormal coordinate position among the first to N-th distortion correction coordinate positions on the basis of respective intervals between the adjacent first to N-th distortion correction coordinate positions indicated by the distortion correction data. The image distortion correction circuit corrects a part corresponding to the abnormal coordinate position in the distortion correction data on the basis of at least the two distortion correction coordinate positions excluding the abnormal coordinate position among the first to N-th distortion correction coordinate positions.

Poses of a person depicted within video frame may be determined. The poses of the person may be used to generate intermediate video frames between the video frames.

Described are various embodiments of a digital display device comprising a light filed display operatively coupled thereto, and vision correction system and method user same. In one embodiment, a system and method are provided for implementing a viewer-specific image perception adjustment within a defined view zone (e.g. field of view zone).

Described are various embodiments of a digital display device comprising a light filed display operatively coupled thereto, and vision correction system and method user same. In one embodiment, a system and method are provided for implementing a viewer-specific image perception adjustment within a defined view zone (e.g. field of view zone).

A method for calibrating image distortion, apparatus, electronic device, and computer readable storage medium are disclosed. The method for calibrating image distortion includes: obtaining an original image captured by a camera; calculating a deformation degree of foreground objects when the original image includes the foreground objects; and performing a distortion calibration and a spherical projection on the original image to obtain a target image when the deformation degree of the foreground objects is greater than a predetermined threshold. The method for calibrating image distortion provided by the disclosure can realize fast distortion calibration of ultra-wide-angle image with low computational complexity and obtain better calibration effect.