A system for encoding and decoding data-tokens. In some examples, the system may be configured to encode and decode integers. In other cases, the system may be configured to encode and decode symbols or bytes of data.

A client is able to decompress an internal portion of a compressed file on a server without having to download and decompress the part of the compressed file that precedes the internal portion. Initially, when the file is compressed, the state of the compressor, e.g., a dictionary, is periodically captured and stored in association with positions in the compressed file. A server stores the compressor states and positions in association with the compressed file. The client identifies the internal section of the compressed file to the server. The server selects a compressor state whose position is closest to the internal section. The server sends the client the selected compressor state and the internal portion of the compressed file. The client primes a decompressor with the sent compressor state, and the primed decompressor then decompresses the internal portion of the compressed file.

A processor requests that a data transformation operation be performed using another processor, in which the data transformation operation is performed asynchronously. A determination is made that the data transformation operation performed using the other processor has completed unsatisfactorily, and based on the unsatisfactory completion, status relating to performance of the data transformation operation is incomplete. The data transformation operation is then re-executed synchronously using the one processor, and the re-executing provides status information unavailable in performing the data transformation operation asynchronously.

An illustrative embodiment includes a method for checkpointing and restarting an application executing at least in part on one or more central processing units coupled to one or more hardware accelerators. The method comprises checkpointing the application at least in part by: transferring checkpoint data of the application to the one or more hardware accelerators; performing distributed compression of the application checkpoint data at least in part using the one or more hardware accelerators; and writing the compressed application checkpoint data to a storage device. The method further comprises restarting the application at least in part by: reading the compressed application checkpoint data from the storage device; transferring the compressed checkpoint data to one or more hardware accelerators; and performing distributed decompression of the application checkpoint data at least in part using said one or more hardware accelerators.

A dictionary configuration method, a buffer control method, a network side device and a UE are provided. The buffer control method for the network side device includes: receiving, by the network side device, first check information transmitted by the UE; determining, by the network side device, whether content in a compression buffer of the UE is identical to content in a decompression buffer of the network side device; and when the content in the compression buffer is different from the content in the decompression buffer, transmitting, by the network side device, buffer resetting information to the UE.

Disclosed in the present disclosure are a processing method and device for a cache synchronous exception, for solving the problem that no solution for a compression check failure is available in the prior art. According to embodiments of the present disclosure, when caches are out of synchronization, a caching failure notification message is sent to a transmitting device; a reset processing is carried out on a compressed cache area, and a reset instruction is sent; and then subsequent data packet transmission is carried out by using reset cache areas. In the present disclosure, after it is determined that the caches are out of synchronization, the caching failure notification message is sent; the transmitting device performs a reset processing on the compressed cache area, and notifies a receiving device to carry out a reset processing on a decompressed cache area.

A system for encoding and decoding data-tokens. In some examples, the system may be configured to encode and decode integers. In other cases, the system may be configured to encode and decode symbols or bytes of data.

An illustrative embodiment includes a method for checkpointing and restarting an application executing at least in part on one or more central processing units coupled to one or more hardware accelerators. The method comprises checkpointing the application at least in part by: transferring checkpoint data of the application to the one or more hardware accelerators; performing distributed compression of the application checkpoint data at least in part using the one or more hardware accelerators; and writing the compressed application checkpoint data to a storage device. The method further comprises restarting the application at least in part by: reading the compressed application checkpoint data from the storage device; transferring the compressed checkpoint data to one or more hardware accelerators; and performing distributed decompression of the application checkpoint data at least in part using said one or more hardware accelerators.

A system and method for data compression with protocol adaptation, that utilizes a codebook generator which leverages one or more machine/deep learning algorithms trained on at least a plurality of protocol policies in order to generate a protocol appendix and codebook, wherein original data is encoded by an encoder according to the codebook and sent to a decoder, but instead of just decoding the data according to the codebook to reconstruct the original data, data manipulation rules such as mapping and transformation are applied at the decoding stage to transform the decoded data into protocol formatted data.

A system and method for encrypted data compression, which uses frequency analysis on data blocks within an input data stream to produce a prefix table, representing a first layer of transformation, and which applies a Burrow's-Wheeler transform (BWT) to the data inside the prefix table, representing a second layer of transformation, and which compresses the transformed data. In some implementations, the system and method may further include applying the BWT to a conditioned stream of genomic data, wherein the conditioned stream of data is accompanied by an error stream comprising the differences between the original data and the encrypted data.