G06T7/223

Motion estimation method, chip, electronic device, and storage medium

The present disclosure relates to a motion estimation method, a chip, an electronic device, and a storage medium. The present disclosure is beneficial to improving the accuracy of motion estimation.

ENHANCED ANIMATION GENERATION BASED ON MOTION MATCHING USING LOCAL BONE PHASES

Systems and methods are provided for enhanced animation generation based on using motion mapping with local bone phases. An example method includes accessing first animation control information generated for a first frame of an electronic game including local bone phases representing phase information associated with contacts of a plurality of rigid bodies of an in-game character with an in-game environment. Executing a local motion matching process for each of the plurality of local bone phases and generating a second pose of the character model based on the plurality of matched local poses for a second frame of the electronic game.

ENHANCED ANIMATION GENERATION BASED ON MOTION MATCHING USING LOCAL BONE PHASES

Systems and methods are provided for enhanced animation generation based on using motion mapping with local bone phases. An example method includes accessing first animation control information generated for a first frame of an electronic game including local bone phases representing phase information associated with contacts of a plurality of rigid bodies of an in-game character with an in-game environment. Executing a local motion matching process for each of the plurality of local bone phases and generating a second pose of the character model based on the plurality of matched local poses for a second frame of the electronic game.

Methods and apparatus for motion estimation based on region discontinuity

The present disclosure relates to methods and devices for image or frame processing including an apparatus, e.g., a GPU. In some aspects, the apparatus may identify a discontinuity between at least one first region of a first frame and at least one second region of a second frame, the at least one first region corresponding to the at least one second region. The apparatus may also determine whether the discontinuity between the at least one first region and the at least one second region is greater than or equal to a motion estimation threshold. The apparatus may also skip a motion estimation for the at least one first region and the at least one second region when the discontinuity between the at least one first region and the at least one second region is greater than or equal to the motion estimation threshold.

Extensions of inter prediction with geometric partitioning

A method for processing a video includes performing a determination, by a processor, that a first video block is partitioned to include a first prediction portion that is non-rectangular and non-square; adding a first motion vector (MV) prediction candidate associated with the first prediction portion to a motion candidate list associated with the first video block, wherein the first MV prediction candidate is derived from a sub-block MV prediction candidate; and performing further processing of the first video block using the motion candidate list.

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM
20230079969 · 2023-03-16 ·

An information processing apparatus includes a motion analysis unit configured to analyze a motion of an object in a moving image, a sound identification unit configured to identify detected sound by analyzing the detected sound while playing the moving image, and a control unit configured to perform processing corresponding to a combination of motion information including an analysis result of the motion of the object and sound identification information including an identification result of the sound.

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM
20230079969 · 2023-03-16 ·

An information processing apparatus includes a motion analysis unit configured to analyze a motion of an object in a moving image, a sound identification unit configured to identify detected sound by analyzing the detected sound while playing the moving image, and a control unit configured to perform processing corresponding to a combination of motion information including an analysis result of the motion of the object and sound identification information including an identification result of the sound.

SYSTEM, METHOD, AND COMPUTER-READABLE MEDIUM INCLUDING PROGRAM FOR PROVIDING LIVE VIDEO DISTRIBUTION SERVICE
20230132371 · 2023-04-27 · ·

According to one embodiment of the present invention, a live video distribution server helps users appropriately perform the live video distribution. The server provides users with a live video distribution (e.g., live streaming) service for distributing and watching live videos via the user terminals. The server generates advice information to a distributor and displays the advice information on a distributor screen. This configuration may allow users to perform the live video distribution while referring to the advice information presented in real-time.

SYSTEM, METHOD, AND COMPUTER-READABLE MEDIUM INCLUDING PROGRAM FOR PROVIDING LIVE VIDEO DISTRIBUTION SERVICE
20230132371 · 2023-04-27 · ·

According to one embodiment of the present invention, a live video distribution server helps users appropriately perform the live video distribution. The server provides users with a live video distribution (e.g., live streaming) service for distributing and watching live videos via the user terminals. The server generates advice information to a distributor and displays the advice information on a distributor screen. This configuration may allow users to perform the live video distribution while referring to the advice information presented in real-time.

Perceptual importance maps for image processing
11475653 · 2022-10-18 · ·

The present disclosure is directed to techniques for determining a perceptual importance map. The perceptual importance map indicates the relative importance to the human visual system of different portions of an image. The techniques include obtaining cost values for the blocks of an image, where cost values are values used in determining motion vectors. For each block, a confidence value is derived from the cost values. The confidence value indicates the confidence with which the motion vector is believed to be correct. A perceptual importance value is determined based on the confidence value via one or more modifications to the confidence value to better reflect importance to the human visual system. The generated perceptual importance values can be used for various purposes such as allocating bits for encoding, identifying regions of interest, or selectively rendering portions of an image with greater or lesser detail based on relative perceptual importance.