Methods and apparatus for preparation of casual stereoscopic video

Patent metadata

Field	Value
Publication number	US-9973742-B2
Application number	US-95696510-A
Country	US
Kind code	B2
Filing date	Nov 30, 2010
Priority date	Sep 17, 2010
Publication date	May 15, 2018
Grant date	May 15, 2018

Abstract

A pair of video streams is prepared for stereoscopic display. A pair of frames is rectified. Each of the pair of frames is from a respective stream of the pair of video streams. A reduced video stream is generated by removing from one of the pair of video streams a set of correlative data that is present in or can be predicted from the other of the pair of video streams. The reduced video stream and the other of the pair of video streams are compressed for use in stereoscopic display of the reduced video stream and the other of the pair of video streams.

First claim

What is claimed is:

1. A method implemented by a video system, the method comprising:
receiving a pair of video streams, each video stream including a set of image frames captured from different perspectives, the pair of video streams including a primary video stream and a secondary video stream;
determining removable image content for removal from at least one image frame of the set of image frames associated with the secondary video stream, said determining based on the removable image content being available from the set of image frames associated with the primary video stream;
reducing a data size of the secondary video stream for a reduced video stream by eliminating the removable image content from the secondary video stream;
encrypting the primary video stream using first encryption associated with a first set of digital management right (DRM) options, the first set of DRM options allowing playback of the primary video stream for two-dimensional (2D) video display;
encrypting the reduced video stream using second encryption associated with a second set of DRM options, the second encryption being different from the first encryption, and the second set of DRM options allowing playback of the primary video stream with the reduced video stream for three-dimensional (3D) video display; and
distributing both the primary video stream and the reduced video stream as two separate video streams to a plurality of users, the first and second encryption controlling the 2D and 3D video display by the plurality of users by:
enabling a first set of the users associated with the first set of DRM options the playback in 2D video display; and
enabling a second set of the users associated with the second set of DRM options the playback in 3D video display.

2. The method as recited in claim 1 , wherein the removable image content available from the set of image frames associated with the primary video stream comprises the removable image content being included in the set of image frames associated with the primary video stream.

3. The method as recited in claim 1 , wherein the removable image content available from the set of image frames associated with the primary video stream comprises the removable image content being predictable from the set of image frames associated with the primary video stream.

4. The method as recited in claim 1 , wherein the first set of DRM options further prohibits the playback of the primary video stream with the reduced video stream for the 3D video display.

5. The method as recited in claim 1 , wherein said determining of the removable image content for removal on a frame-by-frame basis comprises comparing an image frame of the primary video stream to an image frame of the secondary video stream.

6. The method as recited in claim 5 , wherein said comparing the image frame of the primary video stream to the image frame of the secondary video stream comprises using a mesh-based transformation that sections the image frames for a cell-by-cell comparison of feature points in the image frames.

7. The method as recited in claim 1 , further comprising associating the first and second sets of users with the first and second sets of DRM options, respectively, based on a differentiation factor.

8. The method as recited in claim 1 , further comprising:
compressing the primary video stream with first compression; and
compressing the reduced video stream with second compression, the first compression compressing the primary video stream more than the second compression compresses the reduced video stream.

9. A video system, comprising:
a data interface configured to receive a pair of video streams, each video stream including a set of image frames captured from different perspectives, the pair of video streams including a primary video stream and a secondary video stream;
a memory and processor to implement a video production module configured to:
determine removable image content for removal from at least one image frame of the set of image frames associated with the secondary video stream, the determination based on the removable image content being available from the set of image frames associated with the primary video stream;
reduce a data size of the secondary video stream for a reduced video stream by elimination of the removable image content from the secondary video stream;
encrypt the primary video stream using first encryption associated with a first set of digital management right (DRM) options, the first set of DRM options allowing playback of the primary video stream for two-dimensional (2D) video display;
encrypt the reduced video stream using second encryption associated with a second set of DRM options, the second set of DRM options allowing playback of the primary video stream with the reduced video stream for three-dimensional (3D) video display;
distribute both the primary video stream and the reduced video stream as two separate video streams to a plurality of users, the first and second encryption controlling 2D and 3D video display by the plurality of users based on associations of users with the first or second set of DRM options.

10. The video system as recited in claim 9 , wherein the removable image content available from the set of image frames associated with the primary video stream comprises the removable image content being included in the set of image frames associated with the primary video stream.

11. The video system as recited in claim 9 , wherein the removable image content available from the set of image frames associated with the primary video stream comprises the removable image content being predictable from the set of image frames associated with the primary video stream.

12. The video system as recited in claim 9 , wherein the primary video stream is usable with the reduced video stream for a stereoscopic display of a subject captured in the image frames of the pair of video streams.

13. The video system as recited in claim 9 , wherein the video production module is configured to determine the removable image content for removal on a frame-by-frame basis, the determination comprising a comparison of an image frame of the primary video stream to an image frame of the secondary video stream.

14. The video system as recited in claim 13 , wherein the video production module is configured to compare the image frame of the primary video stream to the image frame of the secondary video stream comprising using a mesh-based transformation that sections the image frames for a cell-by-cell comparison of feature points in the image frames.

15. The video system as recited in claim 9 , wherein the video production module is configured to:
compress the primary video stream with first compression; and
compress the reduced video stream with second compression, the first compression compressing the primary video stream more than the second compression compresses the reduced video stream.

16. The video system as recited in claim 15 , wherein the video production module is configured to associate a first set of the users and a second set of the users with the first and second sets of DRM options, respectively, based on a differentiation factor.

17. A stereoscopic video system, comprising:
a user interface configured to receive a selection of a pair of video streams, each video stream including a set of image frames captured from different perspectives, the pair of video streams including a right channel video stream and a left channel video stream;
a memory and processor to implement one or more modules for video production to:
de

Assignees

• Swaminathan Viswanathan
• Kim Hyojin
• Adobe Systems Inc

Inventors

• Swaminathan Viswanathan
• Kim Hyojin

Classifications

• G06T2207/10021

  Stereoscopic video; Stereoscopic image sequence · CPC title

• H04N13/0239 Primary

  Electricity · mapped topic

• H04N19/61

  in combination with predictive coding · CPC title

• G06T7/593

  from stereo images · CPC title

• H04N19/597

  specially adapted for multi-view video sequence encoding · CPC title