A method of data compression includes obtaining binary sensor data having rows with multi-bit data samples. The rows are divided into data groups each including two or more samples. A precedent value is selected for the rows or respective precedent values are selected for each data group. A compressed row of compressed sensor data is generated from each row by calculating differences between the data sample and the precedent value for its associated data groups. A Compression Information Packet (CIP) is generated for each row including information for returning the binary sensor data that includes a compressed predicate indicating whether each data group is stored compressed, a data group size being a multi-bit value that stores a group size used for row compression, and a compressed word size that stores a dynamic range of the row compression. The compressed rows are stored as stored compressed data along with the CIPs.

An encoding device 100 encodes a plurality of input text files to a plurality of encoded files by using a static dictionary unit 121 and a dynamic dictionary unit 122. The dynamic dictionary unit 122 is generated in accordance with word appearance frequencies in the plurality of text files. The encoding device 100 generates a coupled encoded file that includes the plurality of encoded files, information on the dynamic dictionary unit 122, and position information that indicates positions of the respective plurality of encoded files.

The following description is directed to decompression using cascaded history buffers. In one example, an apparatus can include a decompression pipeline configured to decompress compressed data comprising code words that reference a history of decompressed data generated from the compressed data. The apparatus can include a first-level history buffer configured to store a more recent history of the decompressed data received from the decompression pipeline. The apparatus can include a second-level history buffer configured to store a less recent history of the decompressed data received from the first-level history buffer.

An information processing device includes: a memory configured to store data concerning a write access; and a processor coupled to the memory, the processor being configured to: record, for each data, time of a write access of the data to management information, when writing out data from the memory to a storage, determine a plurality of data as a group of overall compression based on the management information, the plurality of data having a difference of time of write accesses being equal to or less than a threshold value, and compress the plurality of data corresponding to the determined group by an overall compression, and write compressed data obtained through the overall compression to the storage.

A detection learning module is used for enabling and/or disabling real-time compression detection by maintaining a history of real-time compression detection success for sampled data. The enabling or disabling of the real-time compression detection is based on a detection benefit function derived from a set of calculated heuristics indicating the real-time compression detection success on input streams. The detection benefit function is calculated based on at least one heuristic score.

Methods and systems are provided for the compression and decompression of data. The compression and decompression of data may include partitioning the data into chunks, analyzing the individual chunks to determine the best compression and decompression encoders to utilize for the next data chunk of a data file. In compressing and decompressing using the mentioned technique, the data is delivered to the requesting client in an efficient and speedy manner.

The present invention aims to automatically determine an encoding parameter in consideration of a condition of compression efficiency and a memory usage and performing encoding based on the determined encoding parameter. To do so, an information processing method of an information processing apparatus comprises: estimating a memory usage concerning holding of a correspondence table of a part of structured data and codes; and estimating a compression effect obtained when the structured data is encoded, by holding the correspondence table, wherein a data size of the correspondence table is variable according to a value of a parameter, and the information processing method further comprises, under a condition of the memory usage, determining the value of the parameter on the basis of the estimated memory usage and the estimated compression effect, and encoding the structured data on the basis of the determined value of the parameter.

The present disclosure provides a data processing system and method. The method may include obtaining preliminary data. The method may also include generating first encoded data by compressing the preliminary data in a first encoding procedure. The method may further include determining whether a compression ratio of the first encoded data is below a compression threshold. The method may still further include generating second encoded data by compressing the preliminary data in a second encoding procedure in response to determining that the compression ratio of the first encoded data is below the compression threshold, wherein the first encoding procedure and the second encoding procedure are lossless compressions.

An information processing device includes: a memory; and a processor coupled to the memory and the processor configured to: generate compressed data, in sets of a prescribed size, in respect of one set of object data, in accordance with each of a plurality of compression methods; and select compressed data of the compression method which has completed compression of the object data first, among the plurality of compression methods.

A data processing apparatus includes a circuit selecting unit and a decoding processor. The circuit selecting unit selects a decoder circuit for each data part of encoded target data. The decoder circuit is suitable for an arrangement of run lengths in the data part. The decoding processor performs reconfiguration to form the decoder circuit selected for the data part, and decodes the target data.