The present technology relates to devices and systems for multidimensional data visualization and interaction in an augmented reality, virtual reality, or mixed reality image guided surgery. The disclosed embodiment provides a tool for a physician or other medical specialist to load and review medical scans in an AR/VR/MR environment, assisting medical diagnostics, surgical planning, medical education, or patient engagement.

A method includes acquiring a current picture segmented into a plurality of units and divided into a plurality of tiles, each unit divided into a plurality of blocks, the plurality of blocks in each unit being arranged as a first grid, and the plurality of units being arranged as a second grid in each tile. The method includes decoding, for one of the units in a first tile, a first current block from the plurality of blocks using an entry from a first HMVP buffer associated with the first tile. The method includes updating the first HMVP buffer with a motion vector of the decoded first current block. The method includes in response to determining that the first current block is located in a first column and a first row of a first unit of a row in the second grid of the first tile, resetting the first HMVP buffer.

A method includes acquiring a current picture segmented into a plurality of units and divided into a plurality of tiles, each unit divided into a plurality of blocks, the plurality of blocks in each unit being arranged as a first grid, and the plurality of units being arranged as a second grid in each tile. The method includes decoding, for one of the units in a first tile, a first current block from the plurality of blocks using an entry from a first HMVP buffer associated with the first tile. The method includes updating the first HMVP buffer with a motion vector of the decoded first current block. The method includes in response to determining that the first current block is located in a first column and a first row of a first unit of a row in the second grid of the first tile, resetting the first HMVP buffer.

Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. In some embodiments, the processing circuitry decodes prediction information of a current block in a current coding from a coded video bitstream. The prediction information is indicative of an intra block copy mode. Then, the processing circuitry determines a block vector that points to a reference block in a same picture as the current block. The reference block is restricted within a coding region with reconstructed samples buffered in a reference sample memory. The coding region is one of multiple predefined regions of a coding tree unit (CTU). Then, the processing circuitry reconstructs at least a sample of the current block based on the reconstructed samples of the reference block that are retrieved from the reference sample memory.

The disclosure discloses a method for processing video signals and an apparatus therefor. Specifically, the method of processing video signals based on inter prediction, comprising: configuring a merge candidate list based on a spatial neighboring block and a temporal neighboring block to a current block; adding a history-based merge candidate of the current block to the merge candidate list; obtaining a merge index indicating a merge candidate used for an inter prediction of the current block within the merge candidate list; generating a prediction sample of the current block based on motion information of the merge candidate indicated by the merge index; and updating a history-based merge candidate list based on the motion information.

A video encoding system encodes source image data corresponding with an image includes a low resolution pipeline that receives the source image data corresponding with a first coding block in the image. The low resolution pipeline includes a low resolution motion estimation block programmed to generate a first downscaled coding block by downscaling resolution of the source image data corresponding with the first coding block. The first downscaled coding block comprises a first downscaled prediction block corresponding with a first prediction block in the first coding block. The low resolution pipeline may also perform several low resolution motion estimation searches to generate motion vector candidates. The video encoding system also includes a main pipeline that receives the source image data and determines encoding parameters to be used to encode the first coding block based at least partially on the motion vector candidates.

A video encoding system encodes source image data corresponding with an image includes a low resolution pipeline that receives the source image data corresponding with a first coding block in the image. The low resolution pipeline includes a low resolution motion estimation block programmed to generate a first downscaled coding block by downscaling resolution of the source image data corresponding with the first coding block. The first downscaled coding block comprises a first downscaled prediction block corresponding with a first prediction block in the first coding block. The low resolution pipeline may also perform several low resolution motion estimation searches to generate motion vector candidates. The video encoding system also includes a main pipeline that receives the source image data and determines encoding parameters to be used to encode the first coding block based at least partially on the motion vector candidates.

An apparatus calculates a block vector difference (BVD) between a block vector (BV) and a block vector predictor (BVP). The apparatus determines each of a plurality of BV candidates based on a sum of the BVP and a different one of a plurality of BVD candidates. Each of the plurality of BVD candidates comprises: a first and a second component magnitude of the BVD; and a different combination of signs for the first and second component magnitudes. The apparatus determines validities of the plurality of BV candidates based on values of samples, stored in a reference memory, of reference blocks indicated by the plurality of BV candidates. The apparatus signales, in a bitstream, a sign for at least one of the first and second component magnitudes of the BVD based on the validities of the plurality of BV candidates.

An apparatus calculates a block vector difference (BVD) between a block vector (BV) and a block vector predictor (BVP). The apparatus determines each of a plurality of BV candidates based on a sum of the BVP and a different one of a plurality of BVD candidates. Each of the plurality of BVD candidates comprises: a first and a second component magnitude of the BVD; and a different combination of signs for the first and second component magnitudes. The apparatus determines validities of the plurality of BV candidates based on values of samples, stored in a reference memory, of reference blocks indicated by the plurality of BV candidates. The apparatus signales, in a bitstream, a sign for at least one of the first and second component magnitudes of the BVD based on the validities of the plurality of BV candidates.

A method of coding video data, including constructing a history-based motion vector prediction (HMVP) candidate history table that includes motion vector information of previously coded blocks that extend beyond adjacent neighboring blocks of a current block, constructing a motion vector predictor list, and adding one or more HMVP candidates from the HMVP candidate history table to the motion vector predictor list. Adding the one or more HMVP candidates from the HMVP candidate history table comprises comparing a first HMVP candidate in the HMVP candidate history table to two entries in the motion vector predictor list and no other entries, and adding the first HMVP candidate to the motion vector predictor list when the first HMVP candidate is different than both of the two entries in the motion vector predictor list. The method also includes coding the current block of video data using the motion vector predictor list.