Method of processing data, and photographing apparatus using the method
09779099 · 2017-10-03
Assignee
Inventors
Cpc classification
G06F16/11
PHYSICS
International classification
Abstract
Disclosed is a method of data processing in an apparatus such as a photographing apparatus. The method includes: determining a file format to record data among a plurality of file formats comprising a dedicated file format and a common file format; recording the data in a file of the common file format and generating an auxiliary file corresponding to the file of the common file format, if the common file format is determined; and recording, in the auxiliary file, information about the dedicated file format and recording information for reading the data in the file of the common file format.
Claims
1. A method of data processing in a surveillance camera which comprises an image sensor and a hardware signal processor, the method comprising: controlling the hardware signal processor to determine a file format, in which data output from the image sensor is to be recorded in a file, among a plurality of file formats comprising a dedicated file format and a common file format; and in response to the file format being determined as the common file format, controlling the hardware signal processor to record the data in a file of the common file format, generate an auxiliary file of the dedicated file format, and record, in the auxiliary file, information about the dedicated file format and recording information required for reading the data recorded in the file of the common file format, the recording information comprising an index value and an offset position value of the data in the file of the common file format; and controlling the hardware signal processor to extract a data unit of the data recorded in the file of the common file format by using the recording information in the auxiliary file of the dedicated file format, extract the information recorded in the auxiliary file of the dedicated file format, and stream the file by alternately transmitting the data unit and the information through a network to a receiver operating according to a dedicated program corresponding to the dedicated file format, wherein the file of the common file format and the auxiliary file of the dedicated file format are recorded in a memory of the surveillance camera which obtains the data, and wherein the dedicated file format is a format where frame headers and the data are alternately disposed, each of the frame headers containing same information.
2. The method of claim 1, further comprising compressing the data by encoding the data before the data is recorded in the file of the common file format.
3. The method of claim 2, wherein the dedicated file format is a file format having a file extension “dat” for the file, and wherein the common file format is one of Audio Video Interleaved (AVI), MatrosKa Video (MKV), Moving Picture Experts Group-4 (MPEG-4), Window Media Video (WMV) and MPEG-3.
4. The method of claim 1, further comprising controlling the hardware signal processor to record the data in a file of the dedicated file format if the dedicated file format is determined in the determining the file format.
5. The method of claim 4, wherein the controlling the hardware signal processor to stream the file comprises controlling the hardware signal processor to: read and transmit the data and the frame header in the file of the dedicated file format from the surveillance camera to the receiver through a network, wherein the dedicated file format is recorded in a memory of the surveillance camera which obtains the data.
6. The method of claim 5, wherein the dedicated file format is a file format having a file extension “dat” for the file, and wherein the common file format is one of Audio Video Interleaved (AVI), MatrosKa Video (MKV), Moving Picture Experts Group-4 (MPEG-4), Window Media Video (WMV) and MPEG-3.
7. A surveillance camera comprising: an image sensor configured to output data corresponding to at least a captured image; and a hardware signal processor configured to determine a file format, in which the data is to be recorded in a file, among a plurality of file formats comprising a dedicated file format and a common file format, wherein, in response to the file format being determined as the common file format, the hardware signal processor is configured to record the data in a file of the common file format, generate an auxiliary file of the dedicated file format, and record, in the auxiliary file, information about the dedicated file format and recording information required for reading the data recorded in the file of the common file format, the recording information comprising an index value and an offset position value of the data in the file of the common file format, and wherein the hardware signal processor is further configured to extract a data unit of the data recorded in the file of the common file format by using the recording information in the auxiliary file of the dedicated file format, extract the information recorded in the auxiliary file of the dedicated file format, and stream the file by alternately transmitting the data unit and the information through a network to a receiver operating according to a dedicated program corresponding to the dedicated file format, wherein the file of the common file format and the auxiliary file of the dedicated file format are recorded in a memory of the surveillance camera which obtains the data, and wherein the dedicated file format is a format where frame headers and the data are alternately disposed, each of the frame headers containing same information.
8. The surveillance camera claim 7, wherein the hardware signal processor is further configured to compress the data by encoding the data before the data is recorded in the file of the common file format.
9. The surveillance camera of claim 8, wherein the dedicated file format is a file format having a file extension “dat” for the file, and wherein the common file format is one of Audio Video Interleaved (AVI), MatrosKa Video (MKV), Moving Picture Experts Group-4 (MPEG-4), Window Media Video (WMV) and MPEG-3.
10. The surveillance camera of claim 7, wherein the hardware signal processor is further configured to record the data in a file of the dedicated file format if the dedicated file format is determined in the determining the file format.
11. The surveillance camera of claim 10, wherein the hardware signal processor is further configured to read and transmit the data and the frame header in the file of the dedicated file format from the surveillance camera to the receiver through a network in a streaming scheme.
12. The surveillance camera of claim 11, wherein the dedicated file format is a file format having a file extension “dat” for the file, and wherein the common file format is one of Audio Video Interleaved (AVI), MatrosKa Video (MKV), Moving Picture Experts Group-4 (MPEG-4), Window Media Video (WMV) and MPEG-3.
13. The method of claim 1, wherein the information about the dedicated file format includes: data indicating a first position of the frame; an index value of a moving-image file of the dedicated file format; a codec format of moving-image data; an offset position value of the moving-image file of the dedicated file format; and a total size value of the moving-image data.
14. The surveillance camera of claim 7, wherein the information about the dedicated file format includes: data indicating a first position of the frame; an index value of a moving-image file of the dedicated file format; a codec format of moving-image data; an offset position value of the moving-image file of the dedicated file format; and a total size value of the moving-image data.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The above and other aspects will become more apparent by describing in detail exemplary embodiments with reference to the attached drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS
(16) The attached drawings for illustrating exemplary embodiments are referred to in order to gain a sufficient understanding of inventive concept, the merits thereof, and the objectives accomplished by the implementation of the inventive concept.
(17) Hereinafter, the inventive concept will be described in detail by explaining exemplary embodiments with reference to the attached drawings. Like reference numerals in the drawings denote like elements.
(18)
(19) Referring to
(20) The optical system (OPS) including a lens unit and a filter unit optically processes light from a subject.
(21) The optical-to-electrical converter (OEC) including a charge coupled device (CCD) or the complementary metal-oxide-semiconductor (CMOS) converts light from the OPS to electric analog signals. Here, the DSP 107 acts as the main controller and controls the timing circuit 102 to control operation of the OEC and the CDS-ADC 101. The CDS-ADC 101 as the analog-digital converter processes analog image signals from the OEC, removes the high frequency noise and adjusts the amplitude, and converts the analog image signals into digital image data. The digital image data is input to the DSP 507.
(22) The DSP 107 for performing overall control processes digital signals from the CDS-ADC device 101, and generates digital image data classified as luminance and chrominance signals.
(23) The audio processor 513 outputs voice signals from the microphone (MIC) to the signal processor 507.
(24) Digital image data from the DSP 107 is temporarily stored in the dynamic random access memory (DRAM) 104. An algorithm necessary for operation of the DSP 107 is stored in the electrically erasable and programmable read only memory (EEPROM) 105.
(25) The DSP 107 generates a file of one of a plurality of file formats including a dedicated file format and a common file format within a flash memory (FM) 106, for example, a secure digital (SD) card, according to a user's selection, and records data obtained by the DSP 107 in the generated file. Here, a user's selection signal may be provided from a computer (3a, 3b or 3c of
(26) A data recording method performed by the DSP 107 will be described in detail with reference to
(27) Furthermore, the DSP 107 communicates with the computers (3a, 3b and 3c of
(28) Here, the computers 3a, 3b and 3c are operated according to a dedicated program for security, and thus, the DSP 107 should transmit data in a dedicated file format in a streaming scheme.
(29)
(30) Referring to
(31) Here, the motion joint photographic experts group (MJPEG) encoder, etc. may be used instead of the MPEG encoder 306. Furthermore, a well-known audio encoder may be added to the DSP 107.
(32) The data formatter 302 operated under the control of the core processor 301 aligns the digital image data from the CDS-ADC (101 of
(33) The data conversion unit 303 operated by the control of the core processor 301 converts digital image data of red (R), green (G) and blue (B) format into digital image data of luminance (Y) and color difference (Cb, Cr) format.
(34) A plurality of resizers 304 and 305 operated according to the control of the core processor 301 converts the resolution of digital image data from the CDS-ADC 101.
(35) The MPEG encoder 306 is a video encoder, which is operated by the control of the core processor 301 and compresses video data of a live view from the CDS-ADC 101.
(36) The JPEG encoder 460 is a still image encoder, which is operated under the control of the core processor 301 and compresses still image data from the CDS-ADC 501.
(37) The change-area detection unit 308 analyzes live-view video data from the CDS-ADC 101 and detects a change-area.
(38)
(39) Referring to
(40) The resolution output in a plurality of resizers 401 is one of D1 resolution of 720×480, CIF resolution of 352×288, and QCIF resolution of 176×144.
(41) As such, the MPEG encoder 306, which is a video encoder, compresses video data of one of the D1 resolution, the CIF resolution and the QCIF resolution. Furthermore, the JPEG encoder 406, which is a still image encoder, compresses still image data of one of the D1 resolution, the CIF resolution and the QCIF resolution.
(42) However, the change-area detection unit 308, which requires a quick process time, analyzes the video data of the CIF resolution.
(43) The core processor 301 communicates with computers 3a, 3b and 3c through the communication channel D.sub.COM, and transmits moving-image compression data and still image compression data of various resolutions through the image data channel D.sub.IMA. However, the core processor 301 may also transmit audio compression data or other data to the computers 3a, 3b and 3c through the image data channel D.sub.IMA or a separate channel (not shown). Such data is transmitted in a streaming scheme of a dedicated file format. Here, at least one of the communication channel D.sub.COM, the image data channel D.sub.IMA and the separate channel, if any, may be formed by the Internet or an intranet.
(44) Furthermore, the core processor 301 transmits information data of a change-area to the computers 3a, 3b and 3c through the image data channel D.sub.IMA.
(45) Furthermore, the core processor 301 generates a file of one of a plurality of file formats including a dedicated file format and a common file format within a flash memory (FM) (106 of
(46)
(47) First, the DSP 107 determines a file format selected by a user (S500).
(48) If the file format is a dedicated file format, the DSP 107 generates a file of a dedicated file format, and records data in the generated file (S501). Here, the data includes video data and audio data not being limited thereto. In the present embodiment, the video data and the audio data may have been respectively compressed.
(49) If the file format is a common file format, operations S511, S513 and S515 are performed. Some examples of the common file format are Audio Video Interleaved (AVI), MatrosKa Video (MKV), Moving Picture Experts Group-4 (MPEG-4), Window Media Video (WMV) and Moving Picture Experts Group-3 (MPEG-3).
(50) In operation S511, the DSP 107 generates a file of a common file format, and records data in the generated file.
(51) In operation S513, the DSP 107 generates an auxiliary file corresponding to the file of the common file format.
(52) Furthermore, in operation S513, the DSP 107 records the recording information and information about the dedicated file format in the auxiliary file. Here, the recording information means recording information for reading data in a file of the common file format.
(53)
(54) Referring to
(55) That is, the dedicated file format in the present embodiment is a format where frame headers 611, 613, 615 and 617 and data 612, 614, 616 and 618 are alternately disposed.
(56) The frame header 611, 613, 615 or 617 includes information about a dedicated file format. Respective frame headers 611, 613, 615 and 617 include the same data.
(57)
(58) Referring to
(59)
(60) Referring to
(61)
(62) Referring to
(63) As is known well, the index value 911 and the offset position value 912 of the file are obtained in a process of recording data, and are used to read the data.
(64) According to a recording method described with reference to
(65) Here, the amount of the recording information 812 and the information 811 of the dedicated file format is much less than the data.
(66) Hence, the file 71 of the common file format may be transmitted to an external side, for example, the computer (3a, 3b or 3c of
(67)
(68) Another example of a data recording method performed by the DSP 107 will be described below with reference to
(69) First, the DSP 107 reads data of a unit frame and a frame header of a dedicated file format (operation (a)).
(70) Furthermore, the DSP 107 records the frame header (e.g., 1101) of the dedicated file format in the file 61s of the dedicated file format (operation (b)).
(71) Information (811 of
(72) The recording information for reading data in the file 71 of the common file format includes the index value (911 of
(73) If the file format to be stored according to a user's selection is a common file format, the DSP 107 records the data (e.g., 712) of the unit frame in the file 71 of the common file format (operations (c1) and (c2)).
(74) If the file format to be stored according to the user's selection is the dedicated file format, the DSP 107 records the data (e.g., 612) of the unit frame in the file (61s) of the dedicated file format (operations (c1) and (c2)). In the present embodiment, the dedicated file format is a format where the frame header 1101 to 1109 and data 612, 614, 616 and 618 are alternately disposed. Respective frame headers 1101 to 1109 include the same data.
(75) Likewise, the data includes video data and audio data, and thus, the data (e.g., 612 or 712) of the unit frame is video data or audio data.
(76) The operations (a) to (c3) are repeatedly performed until the data 798 or 618 of the last frame is recorded (operation (d)).
(77) Hence, if the file format to be stored is a common file format, the file (61s) of the dedicated file format in the operation (b) becomes an auxiliary file corresponding to the file 71 of the common file format. Furthermore, if the file format to be stored is a dedicated file format, the file 61s of the dedicated file format in the operation (b) becomes a file 61 of the dedicated file format. Hence, the auxiliary file or file 61 of the dedicated file format may be generated using the file 61s.
(78)
(79) Referring to
(80) The information 811 of the dedicated file format includes data 1201 (SIG) indicating a first position of a frame, an index value 1202 (SP-IND) of the file of the dedicated file format, a codec format 1203 (CODF) of data, an offset position value 1204 (SP-OFST) of the file of the dedicated file format, and a total size value 1205 (DSIZE) of the data.
(81) Furthermore, the recording information 812 for reading data in the file 71 of the common file format includes the index value 911 (GE-IND) and the offset position value 912 (GE-OFST) of the file of the common file format.
(82)
(83) Referring to
(84) Likewise, the dedicated file format is a format where the frame headers 1101 to 1109 and data 612, 614, 616 and 618 are alternately disposed. Respective frame headers 1101 to 1109 include the same data. In
(85) Here, the amount of the recording information and the information about the dedicated file format recorded in respective frame headers 1101 to 1109 is much less than the data.
(86) Hence, the file 71 of the common file format may be transmitted to an external side, for example, the computers (3a to 3c of
(87)
(88) First, the DSP 107 reads the index value 1202 or 911 and the offset position value 1204 or 912 of a file to be transmitted, in the file 61s or 61 of the dedicated file format (S1401).
(89) If a format of the file to be transmitted is a common file format, a file of the dedicated file format in operation S1401 corresponds to reference numeral 61s of
(90) Next, if the format of the file to be transmitted is a common file format (S1403), the DSP 107 performs the following operations.
(91) The DSP 107 reads the frame header (e.g., 1101) of the unit frame in the file 61s of the dedicated file format (S1407).
(92) As such, the DSP 107 reads the data (e.g., 712) of the unit frame in the file 71 of the common file format (S1409).
(93) Next, the DSP 107 transmits the read frame header and data (e.g., 1101 and 712) to an external side, for example, the computer (3a to 3c of
(94) The operations S1407, S1409 and S1411 are repeatedly performed until the frame header and data (e.g., 1104 and 715) of the final frame are transmitted (S1413).
(95) Furthermore, if the format of the file to be transmitted is a dedicated file format (S1403), the DSP 107 performs the following operations.
(96) The DSP 107 reads the frame header (e.g., 611) and data (e.g., 612) in the file 61 of the dedicated file format (S1405).
(97) Next, the DSP 107 transmits the read frame header and the data (e.g., 611 and 612) to an external device, for example, the computer (3a to 3c of
(98) The operations S1405 and S1411 are repeatedly performed until the frame header and date (e.g., 617 and 618) of the last frame are transmitted (S1413).
(99) According to a method of recording data and a photographing apparatus adopting the method of exemplary embodiments, an auxiliary file corresponding to the file of a common file format is generated, and information about the dedicated file format and recording information for reading data in the file of the common file format are recorded in the auxiliary file.
(100) Hence, if data is recorded in a file of the common file format, the data may be extracted by using the recording information, and the extracted data along with the information about the dedicated file format may be transmitted to an external device, for example, a computer.
(101) Here, the amount of the recording information and the information about the dedicated file format is significantly less than the amount of the data.
(102) Therefore, the file of a common file format may be transmitted to an external device as streaming data of a dedicated file format while not causing a capacity problem to arise in recording media.
(103) While the inventive concept has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the inventive concept as defined by the following claims.