Unpacking method, unpacking device and unpacking system of packed frame

Patent metadata

Field	Value
Publication number	US-9774844-B2
Application number	US-201414505153-A
Country	US
Kind code	B2
Filing date	Oct 2, 2014
Priority date	Oct 2, 2013
Publication date	Sep 26, 2017
Grant date	Sep 26, 2017

Abstract

An unpacking method, an unpacking device and an unpacking system of a packed frame are disclosed. The packed frame is to be displayed on a screen and includes a color frame and a resized depth frame, and the color frame is corresponding to the resized depth frame. The center of the color frame is displayed in the central area of the screen. The unpacking method includes the steps of: extracting the color frame and the resized depth frame from the packed frame; and restoring the resized depth frame to obtain an original depth frame.

First claim

What is claimed is:

1. An unpacking method of a packed frame, wherein the packed frame is to be displayed on a screen and comprises a color frame and a resized depth frame, the color frame is corresponding to the resized depth frame, and the center of the color frame is displayed in a central area of the screen, the unpacking method comprising steps of:
extracting the color frame and the resized depth frame from the packed frame; and
restoring the resized depth frame to obtain an original depth frame;
wherein the packed frame comprises a center part and two opposite side parts, the center part is between the two opposite side parts, the step of extracting the color frame and the resized depth frame from the packed frame comprises:
extracting two of the resized depth frame respectively from the two opposite side parts of the packed frame;
combining the two parts of the resized depth frame to obtain the resized depth frame; and
extracting the color frame from the center part of the packed frame.

2. The unpacking method of claim 1 , wherein a center point of the color frame is overlapped with a center point of the screen.

3. The unpacking method of claim 1 , wherein
the two opposite side parts are at a top side and a bottom side of the packed frame.

4. The unpacking method of claim 3 , wherein before combining the two parts of the resized depth frame to obtain the resized depth frame, the step of extracting the color frame and the resized depth frame from the packed frame further comprises:
flipping the two parts of the resized depth frame.

5. The unpacking method of claim 1 , wherein:
the two opposite side parts are at a left side and a right side of the packed frame.

6. The unpacking method of claim 5 , wherein before combining the two parts of the resized depth frame to obtain the resized depth frame, the step of extracting the color frame and the resized depth frame from the packed frame further comprises:
rotating the two parts of the resized depth frame.

7. The unpacking method of claim 1 , further comprising a step of:
restoring the color frame to obtain an original color frame.

8. The unpacking method of claim 1 , wherein the step of restoring the resized depth frame to obtain an original depth frame comprises:
rearranging sub-pixels of the resized depth frame to obtain an intermediate depth frame; and
resizing the intermediate depth frame to obtain the original depth frame.

9. The unpacking method of claim 8 , wherein the size of the intermediate depth frame is triple of the size of the resized depth frame along a column direction.

10. The unpacking method of claim 8 , wherein the step of obtaining the intermediate depth frame is to retrieve a first sub-pixel value and a second sub-pixel value of a pixel of the resized depth frame, to store the first sub-pixel value in all sub-pixels of a first pixel of the intermediate depth frame, and to store the second sub-pixel value to all sub-pixels of a second pixel of the intermediate depth frame.

11. The unpacking method of claim 8 , wherein the size of the original depth frame is 4/3 of the size of the intermediate depth frame along a column direction.

12. The unpacking method of claim 7 , wherein the size of the color frame is A times of the size of the original color frame along a direction, and the size of the intermediate depth frame is B times of the size of the original depth frame along the direction.

13. The unpacking method of claim 12 , wherein A and B fit the equality of A+B/3=1.

14. The unpacking method of claim 12 , wherein A and B are 3/4, respectively.

15. An unpacking device of a packed frame, wherein the packed frame is to be displayed on a screen and comprises a color frame and a resized depth frame, the color frame is corresponding to the resized depth frame, and the center of the color frame is displayed in a central area of the screen, the unpacking device comprising:
an extract processing unit for extracting the color frame and the resized depth frame from the packed frame, wherein the packed frame comprises a center part and two opposite side parts, the center part is between the two opposite side parts, the extract processing unit extracts two parts of the resized depth frame from two opposite side parts of the packed frame, and extracts the color frame from the center part of the packed frame;
a restore processing unit for restoring the resized depth frame to obtain an original depth frame; and
a combine processing unit for combining the two parts of the resized depth frame to obtain the resized depth frame.

16. The unpacking device of claim 15 , wherein a center point of the color frame is overlapped with a center point of the screen.

17. The unpacking device of claim 15 , wherein the two opposite side parts are at a top side and a bottom side of the packed frame.

18. The unpacking device of claim 17 , further comprising:
a rotate processing unit for flipping the two parts of the resized depth frame.

19. The unpacking device of claim 15 , wherein the two opposite side parts are at a left side and a right side of the packed frame.

20. The unpacking device of claim 19 , further comprising:
a rotate processing unit for rotating the two parts of the resized depth frame.

21. The unpacking device of claim 15 , wherein the restore processing unit further restores the color frame to obtain an original color frame.

22. The unpacking device of claim 15 , wherein the restore processing unit rearranges sub-pixels of the resized depth frame to obtain an intermediate depth frame.

23. The unpacking device of claim 22 , wherein the size of the intermediate depth frame is triple of the size of the resized depth frame along a column direction.

24. The unpacking device of claim 22 , wherein the restore processing unit further retrieves a first sub-pixel value and a second sub-pixel value of a pixel of the resized depth frame, stores the first sub-pixel value in all sub-pixels of a first pixel of the intermediate depth frame, and stores the second sub-pixel value to all sub-pixels of a second pixel of the intermediate depth frame.

25. The unpacking device of claim 22 , wherein the size of the original depth frame is 4/3 of the size of the intermediate depth frame along a column direction.

26. The unpacking device of claim 21 , wherein the size of the color frame is A times of the size of the original color frame along a direction, and the size of the intermediate depth frame is B times of the size of the original depth frame along the direction.

27. The unpacking device of claim 26 , wherein A and B fit the equation of A+B/3=1.

28. The unpacking device of claim 26 , wherein A and B are 3/4, respectively.

29. An unpacking system of a packed frame, wherein the packed frame is to be displayed on a screen and comprises a color frame and a resized depth frame, the color frame is corresponding to the resized depth frame, and the center of the color frame is displayed in a central area of the screen, the unpacking system comprising:
a memory unit for storing the packed frame; and
a processing unit for extracting the color frame and the resized depth frame from the packed frame, and restoring the resized depth frame to obtain an original depth frame;
wherein the packed frame comprises a center part and two opposite side parts, the center part is between the two

Assignees

• Univ Nat Cheng Kung

Inventors

• Yang Jar-Ferr
• Wang Hung-Ming
• Tseng Hsi-Chun
• Liao Ke-Ying

Classifications

• H04N19/597 Primary

  specially adapted for multi-view video sequence encoding · CPC title

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title

• H04N13/0422

  Electricity · mapped topic

• H04N13/0048

  Electricity · mapped topic

• H04N2213/003

  Aspects relating to the "2D+depth" image format · CPC title