Unpacking method, unpacking device and unpacking system of packed frame
09774844 · 2017-09-26
Assignee
Inventors
- Jar-Ferr Yang (TaiNan, TW)
- Hung-Ming Wang (Tainan, TW)
- Hsi-Chun Tseng (Zhongli, TW)
- Ke-Ying Liao (Taipei, TW)
Cpc classification
H04N13/161
ELECTRICITY
H04N19/59
ELECTRICITY
H04N13/332
ELECTRICITY
International classification
H04N19/59
ELECTRICITY
H04N19/597
ELECTRICITY
Abstract
An unpacking method, an unpacking device and an unpacking system of a packed frame are disclosed. The packed frame is to be displayed on a screen and includes a color frame and a resized depth frame, and the color frame is corresponding to the resized depth frame. The center of the color frame is displayed in the central area of the screen. The unpacking method includes the steps of: extracting the color frame and the resized depth frame from the packed frame; and restoring the resized depth frame to obtain an original depth frame.
Claims
1. An unpacking method of a packed frame, wherein the packed frame is to be displayed on a screen and comprises a color frame and a resized depth frame, the color frame is corresponding to the resized depth frame, and the center of the color frame is displayed in a central area of the screen, the unpacking method comprising steps of: extracting the color frame and the resized depth frame from the packed frame; and restoring the resized depth frame to obtain an original depth frame; wherein the packed frame comprises a center part and two opposite side parts, the center part is between the two opposite side parts, the step of extracting the color frame and the resized depth frame from the packed frame comprises: extracting two of the resized depth frame respectively from the two opposite side parts of the packed frame; combining the two parts of the resized depth frame to obtain the resized depth frame; and extracting the color frame from the center part of the packed frame.
2. The unpacking method of claim 1, wherein a center point of the color frame is overlapped with a center point of the screen.
3. The unpacking method of claim 1, wherein the two opposite side parts are at a top side and a bottom side of the packed frame.
4. The unpacking method of claim 3, wherein before combining the two parts of the resized depth frame to obtain the resized depth frame, the step of extracting the color frame and the resized depth frame from the packed frame further comprises: flipping the two parts of the resized depth frame.
5. The unpacking method of claim 1, wherein: the two opposite side parts are at a left side and a right side of the packed frame.
6. The unpacking method of claim 5, wherein before combining the two parts of the resized depth frame to obtain the resized depth frame, the step of extracting the color frame and the resized depth frame from the packed frame further comprises: rotating the two parts of the resized depth frame.
7. The unpacking method of claim 1, further comprising a step of: restoring the color frame to obtain an original color frame.
8. The unpacking method of claim 1, wherein the step of restoring the resized depth frame to obtain an original depth frame comprises: rearranging sub-pixels of the resized depth frame to obtain an intermediate depth frame; and resizing the intermediate depth frame to obtain the original depth frame.
9. The unpacking method of claim 8, wherein the size of the intermediate depth frame is triple of the size of the resized depth frame along a column direction.
10. The unpacking method of claim 8, wherein the step of obtaining the intermediate depth frame is to retrieve a first sub-pixel value and a second sub-pixel value of a pixel of the resized depth frame, to store the first sub-pixel value in all sub-pixels of a first pixel of the intermediate depth frame, and to store the second sub-pixel value to all sub-pixels of a second pixel of the intermediate depth frame.
11. The unpacking method of claim 8, wherein the size of the original depth frame is 4/3 of the size of the intermediate depth frame along a column direction.
12. The unpacking method of claim 7, wherein the size of the color frame is A times of the size of the original color frame along a direction, and the size of the intermediate depth frame is B times of the size of the original depth frame along the direction.
13. The unpacking method of claim 12, wherein A and B fit the equality of A+B/3=1.
14. The unpacking method of claim 12, wherein A and B are 3/4, respectively.
15. An unpacking device of a packed frame, wherein the packed frame is to be displayed on a screen and comprises a color frame and a resized depth frame, the color frame is corresponding to the resized depth frame, and the center of the color frame is displayed in a central area of the screen, the unpacking device comprising: an extract processing unit for extracting the color frame and the resized depth frame from the packed frame, wherein the packed frame comprises a center part and two opposite side parts, the center part is between the two opposite side parts, the extract processing unit extracts two parts of the resized depth frame from two opposite side parts of the packed frame, and extracts the color frame from the center part of the packed frame; a restore processing unit for restoring the resized depth frame to obtain an original depth frame; and a combine processing unit for combining the two parts of the resized depth frame to obtain the resized depth frame.
16. The unpacking device of claim 15, wherein a center point of the color frame is overlapped with a center point of the screen.
17. The unpacking device of claim 15, wherein the two opposite side parts are at a top side and a bottom side of the packed frame.
18. The unpacking device of claim 17, further comprising: a rotate processing unit for flipping the two parts of the resized depth frame.
19. The unpacking device of claim 15, wherein the two opposite side parts are at a left side and a right side of the packed frame.
20. The unpacking device of claim 19, further comprising: a rotate processing unit for rotating the two parts of the resized depth frame.
21. The unpacking device of claim 15, wherein the restore processing unit further restores the color frame to obtain an original color frame.
22. The unpacking device of claim 15, wherein the restore processing unit rearranges sub-pixels of the resized depth frame to obtain an intermediate depth frame.
23. The unpacking device of claim 22, wherein the size of the intermediate depth frame is triple of the size of the resized depth frame along a column direction.
24. The unpacking device of claim 22, wherein the restore processing unit further retrieves a first sub-pixel value and a second sub-pixel value of a pixel of the resized depth frame, stores the first sub-pixel value in all sub-pixels of a first pixel of the intermediate depth frame, and stores the second sub-pixel value to all sub-pixels of a second pixel of the intermediate depth frame.
25. The unpacking device of claim 22, wherein the size of the original depth frame is 4/3 of the size of the intermediate depth frame along a column direction.
26. The unpacking device of claim 21, wherein the size of the color frame is A times of the size of the original color frame along a direction, and the size of the intermediate depth frame is B times of the size of the original depth frame along the direction.
27. The unpacking device of claim 26, wherein A and B fit the equation of A+B/3=1.
28. The unpacking device of claim 26, wherein A and B are 3/4, respectively.
29. An unpacking system of a packed frame, wherein the packed frame is to be displayed on a screen and comprises a color frame and a resized depth frame, the color frame is corresponding to the resized depth frame, and the center of the color frame is displayed in a central area of the screen, the unpacking system comprising: a memory unit for storing the packed frame; and a processing unit for extracting the color frame and the resized depth frame from the packed frame, and restoring the resized depth frame to obtain an original depth frame; wherein the packed frame comprises a center part and two opposite side parts, the center part is between the two opposite side parts, the processing unit extracts two parts of the resized depth frame from two opposite side parts of the packed frame and extracts the color frame from the center part of the packed frame, and the processing unit further combines the two parts of the resized depth frame to obtain the resized depth frame.
30. The unpacking system of claim 29, wherein a center point of the color frame is overlapped with a center point of the screen.
31. The unpacking system of claim 29, wherein the two opposite side parts are at a top side and a bottom side of the packed frame.
32. The unpacking system of claim 31, wherein the processing unit further flips the two parts of the resized depth frame.
33. The unpacking system of claim 29, wherein the two opposite side parts are at a left side and a right side of the packed frame.
34. The unpacking system of claim 33, wherein the processing unit further rotates the two parts of the resized depth frame.
35. The unpacking system of claim 29, wherein the processing unit further restores the color frame to obtain an original color frame.
36. The unpacking system of claim 29, wherein the processing unit further rearranges sub-pixels of the resized depth frame to obtain an intermediate depth frame.
37. The unpacking system of claim 36, wherein the size of the intermediate depth frame is triple of the size of the resized depth frame along a column direction.
38. The unpacking system of claim 36, wherein the processing unit further retrieves a first sub-pixel value and a second sub-pixel value of a pixel of the resized depth frame, stores the first sub-pixel value in all sub-pixels of a first pixel of the intermediate depth frame, and stores the second sub-pixel value to all sub-pixels of a second pixel of the intermediate depth frame.
39. The unpacking system of claim 36, wherein the size of the original depth frame is 4/3 of the size of the intermediate depth frame along a column direction.
40. The unpacking system of claim 35, wherein the size of the color frame is A times of the size of the original color frame along a direction, and the size of the intermediate depth frame is B times of the size of the original depth frame along the direction.
41. The unpacking system of claim 40, wherein A and B fit the equality of A+B/3=1.
42. The unpacking system of claim 40, wherein A and B are 3/4, respectively.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The invention will become more fully understood from the detailed description and accompanying drawings, which are given for illustration only, and thus are not limitative of the present invention, and wherein:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
DETAILED DESCRIPTION OF THE INVENTION
(12) The present invention will be apparent from the following detailed description, which proceeds with reference to the accompanying drawings, wherein the same references relate to the same elements.
(13)
(14) As shown in
(15) The unpacking method and device 1 of a packed frame will be described hereinafter with reference to
(16) In this embodiment, the size of the packed frame of
(17) As shown in
(18) After obtaining the two parts of the resized depth frame, the combine processing unit 14 can combine them to obtain a resized depth frame (from
(19) Next, the step S02 is performed to restore the resized depth frame to obtain an original depth frame (restoring
(20) Accordingly, the size of the resized depth frame of
(21) Then, the restore processing unit 12 restores the intermediate depth frame to obtain an original depth frame (restoring
(22) In this embodiment, the unpacking method further includes a step of restoring the color frame to obtain an original color frame (from
(23)
(24) As shown in
(25) The unpacking method and device of a packed frame of a second embodiment will be described hereinafter with reference to
(26) At first, the step S01 of this method is also to extract a color frame and a resized depth frame from the packed frame (extracting two parts of the resized depth frame of
(27) After obtaining the two parts of the resized depth frame, the combine processing unit 14 can combine them to obtain a resized depth frame (from
(28) Next, the step S02 is performed to restore the resized depth frame to obtain an original depth frame (restoring
(29) In this embodiment, the size of the resized depth frame of
(30) Then, the restore processing unit 12 restores the intermediate depth frame to obtain an original depth frame (restoring
(31) In addition, the unpacking method further includes a step of restoring the color frame to obtain an original color frame (from
(32) If the size of the color frame is A times of the size of the original color frame along a direction, and the size of the intermediate depth frame is B times of the size of the original depth frame along the direction, A and B need to fit the equality of A+B/3=1. This invention is not to limit the values of A and B. In the first embodiment, the restore ratio a of the intermediate depth frame along the column direction D2 is the same as the restore ratio b of the color frame along the column direction D2, which means A=B=3/4. In the second embodiment, the restore ratio a of the intermediate depth frame along the row direction D1 is the same as the restore ratio B of the color frame along the row direction D1, which means A=B=3/4.
(33)
(34) As shown in
(35) The unpacking method and device of a packed frame of a third embodiment will be described hereinafter with reference to
(36) The procedure of the third embodiment is mostly the same as the procedure of the second embodiment. In the third embodiment, the extract processing unit 11 extracts the two parts of the resized depth frame from the left and right sides of the packed frame (vertical splitting) so as to obtain two parts of the resized depth frame of
(37) In addition, the sub-pixels of the resized depth frame of
(38) Then, the restore processing unit 12 restores the intermediate depth frame to obtain an original depth frame (restoring
(39) In addition, the color frame of
(40)
(41) As shown in
(42) To be noted, in the first, second and third embodiments, the size of the packed frame and the preset frame size of the original color frame are the same and are both 1920×1080. Accordingly, the packed frame applied in the first, second and third embodiments will not cause additional load for the transmission bandwidth during data transmission, and it will not cause the overloading of the 3D display device in the user end due to the exceeded decompression calculations.
(43)
(44) The unpacking system 2 includes a memory unit 21 and a processing unit 22, which are electrically connected to each other. The memory unit 21 stores the packed frame. Of course, the memory unit 21 also stores the original color frame, the original depth frame, the color frame, the resized depth frame and the two parts thereof. The memory unit 21 can be a non-transitory computer readable storage medium, such as a memory, memory card, CD, tape, or any of their combinations, for storing the needed information. In this embodiment, the memory can be a ROM, RAM, flash memory, FPGA, and any usable memory, and this invention is not limited.
(45) The processing unit 22 includes the core control assembly of the system 2, such as a CPU and a memory, or including any control hardware, software or firmware. In this embodiment, the processing unit 22 extracts two parts of the resized depth frame from the left and right sides of the packed frame, rotates the two parts of the resized depth frame, and combines the two parts of the resized depth frame to obtain the resized depth frame. In addition, the processing unit 22 further rearranges the sub-pixels of the resized depth frame to obtain an intermediate depth frame. In this step, the processing unit 22 retrieves a first sub-pixel value and a second sub-pixel value of a pixel of the resized depth frame, stores the first sub-pixel value in all sub-pixels of a first pixel of the intermediate depth frame, and stores the second sub-pixel value to all sub-pixels of a second pixel of the intermediate depth frame. Moreover, the processing unit 22 restores the intermediate depth frame to obtain an original depth frame. The processing unit 22 also restores the color frame to obtain an original color frame.
(46) In the unpacking system 2, the other technical features of the original depth frame, the intermediate depth frame, the resized depth frame, the color frame, the original color frame and the packed frame have been described in the previous embodiments, so they will be omitted.
(47) To sum up, in the invention, the packed frame includes a color frame and a resized depth frame, and the color frame is corresponding to the resized depth frame. The color frame and the resized depth frame are extracted from the packed frame, and an original depth frame is obtained by restoring the resized depth frame. Accordingly, the unpacking method, unpacking device and unpacking system of the invention are different from the conventional art. In addition, the packed frame can be displayed in a screen, and the center of the color frame is displayed at the central area of the screen. The center point of the color frame and the center point of the screen are preferably overlapped and most preferably totally overlapped. Moreover, the color frames (2D images) are smoothly shown in the central area of a screen and will not make the viewer uncomfortable.
(48) Although the invention has been described with reference to specific embodiments, this description is not meant to be construed in a limiting sense. Various modifications of the disclosed embodiments, as well as alternative embodiments, will be apparent to persons skilled in the art. It is, therefore, contemplated that the appended claims will cover all modifications that fall within the true scope of the invention.