Significance flags in advanced video compression systems are coded using contexts adaptive to the last N significance flags coded taken in a scanning order. One embodiment uses the last N significance flags in scanning order as a predictor to determine which of a plurality of sets of significance flag contexts to use for coding subsequent significance flags. A second embodiment uses the last N significance flags in scanning order as a predictor in order to modulate the probability value associated with significance flag contexts that are used to code significance flags for future coding.

A system and method for file type identification involving extraction of a file-print of a file, the file-print being a unique or practically-unique representation of statistical characteristics associated with the distribution of bits in the binary contents of the file, similar to a fingerprint. The file-print is then passed to a machine learning algorithm that has been trained to recognize file types from their file-prints. The machine learning algorithm returns a predicted file type and, in some cases, a probability of correctness of the prediction. The file may then be encoded using an encoding algorithm chosen based on the predicted file type.

Selecting tables for compression by threshold statistical values. Identified tables are reordered according to fields having the lowest cardinality to increase the size of character strings replaced by keys during compression. Field locations are mapped between the original table and the reordered table. Dictionary-based compression is performed on reordered tables.

A method, article comprising machine-readable instructions and apparatus that processes data systems for encoding, decoding, pattern recognition/matching and data generation is disclosed. State subsets of a data system are identified for the efficient processing of data based, at least in part, on the data system's systemic characteristics.

A disclosure for lossless data compression can include receiving a data block by a processor, performing, by the processor, a sparse transform extraction on the data block, selecting, by the processor, a transform matrix for the data block, modeling, by the processor, the selected transform matrix for the data block, selecting, by the processor, a transform coefficient model for the data block, modeling, by the processor, the selected transform coefficient model for the data block, compressing, by the processor, the data in the data block using the selected transform matrix and the selected transform coefficient model.

One example method includes file specific compression selection. Compression metrics are generated for a chunk of a file using a reference compressor. Compression metrics for other compressors are determined from the metrics of the reference compressor. A compressor is then selected to compress the file.

A method, article comprising machine-readable instructions and apparatus that processes data systems for encoding, decoding, pattern recognition/matching and data generation is disclosed. State subsets of a data system are identified for the efficient processing of data based, at least in part, on the data system's systemic characteristics.

A communication compression method based on model weight distribution in federated learning, and belongs to the technical field of wireless communication. Based on the existing federated average idea in federated learning, counts the distribution of model weight information to be transmitted between nodes during each communication, then performs scalar quantization and compression through Lloyd-Max quantizer according to their distribution characteristics, then encodes with Huffman coding method, and finally sends the codes to the target node, thereby the minimum mean square quantization error is realized and the number of bits required for communication is reduced.

A compression system is disclosed. A compression service removes compression responsibilities from an application. The compression system can deploy virtual network engines to locations near the applications. The virtual network engines compress the data using a compressor selected from multiple compressors. The compressed data can then be transmitted, decompressed, and delivered to the destination.

Methods and devices for decoding, in a video decoder, a block of enhancement-layer transform domain data for an enhancement-layer encoded video and corresponding to a reconstructed block of reference-layer transform domain data, are provided. The method includes determining a context for an enhancement-layer element based, at least in part, upon elements in the corresponding reconstructed block of reference-layer transform domain data, wherein the elements are identified by a template and wherein the position of the template in the reference-layer reconstructed block is based upon the position of that enhancement-layer element in the block of enhancement-layer transform domain data.