A data compression apparatus of the invention includes a data acquisition unit to acquire n integers from encoding data, an integer division unit to divide each integer of the n integers into a second integer represented by low-order bits whose number of divided bits is b and a first integer represented by high-order bits obtained by excluding the low-order bits from each integer of the n integers and to output n first integers and n second integers, a first encoding unit to encode and output the n first integers as a first code represented by binary data having a number of bits that is a natural-number times the number of unit bits of L, and a second encoding unit to encode and output the n second integers as a second code.

Provided is a storage system that can store various types of and large amounts of sensor data while accurately compressing the sensor data without wasting storage resources. The storage system includes: a storage that records sensor data output from a plurality of sensors; a processor that controls recording of sensor data in the storage; and a memory that records parameters of the plurality of sensors. The processor reads parameters assigned to the sensors that output the sensor data from the memory, normalizes the sensor data based on the parameters, compresses the normalized sensor data, and records the compressed sensor data in the storage.

An encoding method is illustrated. The method includes receiving data to be encoded onto a storage media, wherein the data corresponds to an item and is assigned to a data category. Further, the method includes parsing data into a plurality of data portions, based on one or more first characteristics associated with each of one or more characters in the data. The method further includes encoding, by the processor, the plurality of data portions using a plurality of encoding schemes, to generate a data packet, such that a first data portion of the plurality of data portions is encoded using a first encoding scheme of the plurality of encoding schemes and a second data portion of the plurality of data portions is encoded using a second encoding scheme of the plurality of encoding schemes, wherein the first encoding scheme is different from the second encoding scheme. Furthermore, the method includes transmitting the data packet, wherein the data packet is configured to be stored in the storage media.

An image processing apparatus includes a memory configured to store compressed data; and frame buffer compressing circuitry which includes encoder circuitry configured to compress at least some of source data to generate the compressed data and transmit the compressed data to the memory, and decoder circuitry configured to read and decompress the compressed data from the memory, in which the compressed data includes a payload and a header including actual compressed data and flag, the frame buffer compressing circuitry is configured to reflect a result obtained by comparing an accumulated compressibility corresponding to the compressed data with a reference compressibility in the flag, and is configured to perform compression or decompression in a lossy mode or a lossless mode depending on the flag.

A data compression technique involves: selecting, from a data block, a plurality of bit strings as sample data. The technique further involves: determining a set of characters included in the sample data. Each character in the set of characters is represented by at least one bit string among the plurality of bit strings. The technique further involves: compressing the data block if statistical characteristics of the set of characters match predetermined statistical characteristics. Accordingly, incompressible data can be filtered out efficiently and accurately, so as to utilize computing resources more efficiently.

Embodiments of the present disclosure provide a method, an electronic device, and a computer program product for data processing. The method includes: determining, based on sizes of multiple data segments included in data to be processed, a first time required to perform a matching operation for each data segment, wherein the matching operation is used to determine non-duplicate data segments; determining, based on the size of each data segment and a compression level for the data to be processed, a second time required to perform a compression operation for each data segment; and determining, based on the first time, the second time, and a de-duplication rate for the data to be processed, a target mode for processing the multiple data segments from a first mode and a second mode, wherein in the first mode, a compression operation is performed only on the non-duplicate data segments in the multiple data segments, and in the second mode, a compression operation is performed on each of the multiple data segments. In this way, the data processing mode can be dynamically selected according to features of the data to be processed, thereby improving the efficiency of data processing.

Techniques are provided for implementing additional compression for existing compressed data. Format information stored within a data block is evaluated to determine whether the data block is compressed or uncompressed. In response to the data block being compressed according to a first compression format, the data block is decompressed using the format information. The data block is compressed with one or more other data blocks to create compressed data having a second compression format different than the first compression format.

A data storage system in which different copies of a data object (e.g., a file) can be compressed using different compression processes (e.g. different compression algorithms/processes and/or compression parameters), with some favoring faster decompression, while others favoring storage space savings. When a data object needs to be accessed, the copy of the data object that can be decompressed using minimal resource (computing and/or time) can be located and retrieved.

A decoder includes circuitry configured to receive a bitstream identify, in the bitstream, a current frame, wherein the current frame includes a first region and a third region, detect, in the bitstream, an indication that the first region is encoded according to a lossless encoding protocol, and decode the current frame, wherein decoding the current frame further comprises decoding the first region using a lossless decoding protocol corresponding to the lossless encoding protocol.

A method to automatically optimize waveform captures from an electrical system includes capturing at least one energy-related waveform using at least one Intelligent Electronic Device (IED) in the electrical system. The at least one captured energy-related waveform is analyzed to determine if the at least one captured energy-related waveform is capable of being compressed, while maintaining relevant attributes for characterization, analysis and/or other use. In response to determining the at least one captured energy-related waveform is capable of being compressed, while maintaining relevant attributes for characterization, analysis, and/or use, the at least one captured energy-related waveform may be compressed using at least one compression technique to generate at least one compressed energy-related waveform. One or more actions may be taken based on or using the at least one compressed energy-related waveform.