Tailored video streaming for multi-device presentations

Patent metadata

Field	Value
Publication number	US-11272237-B2
Application number	US-201816489296-A
Country	US
Kind code	B2
Filing date	Feb 28, 2018
Priority date	Mar 7, 2017
Publication date	Mar 8, 2022
Grant date	Mar 8, 2022

Abstract

Systems and methods described herein are provided for displaying video content in a multi-device environment where video content may be synchronized between two or more display devices. Video content displayed on one or more of the display devices may be a cropped version (or region of interest) of video content shown on a main display. Some embodiments may make recommendations to determine regions of interest based on contextual cues and user preferences. For some embodiments, a user may indicate a desire to follow a traced object, which may be used to determine regions of interest.

First claim

What is claimed is:

1. A method of sharing media, the method comprising:
receiving, at a primary display device, an encoded video stream;
receiving, at the primary display device, metadata identifying a plurality of tracked objects or regions in the encoded video stream;
decoding the encoded video stream and displaying the decoded video stream at the primary display device;
generating options to request additional viewpoints corresponding to one or more of the plurality of tracked objects or regions, the options generated based on the metadata;
transmitting the options to a secondary display device;
receiving, at the primary display device, a request for a viewpoint corresponding to a tracked object or region selected from the plurality of tracked objects or regions in the decoded video stream; and
responsive to the request:
cropping the tracked object or region of the requested viewpoint from the decoded video stream to produce cropped video of the requested viewpoint;
re-encoding the cropped video; and
transmitting the re-encoded cropped video to the secondary display device.

2. The method of claim 1 , wherein the re-encoded cropped video has a different resolution than the encoded video stream received.

3. The method of claim 1 , wherein transmitting the re-encoded cropped video comprises transmitting the re-encoded cropped video over a wireless local area network (LAN).

4. The method of claim 1 , wherein transmitting the re-encoded cropped video comprises transmitting the re-encoded cropped video using at least one of Universal Plug and Play (UPnP) protocol or Digital Living Network Alliance (DLNA) protocol.

5. The method of claim 1 , wherein transmitting the re-encoded cropped video comprises transmitting the re-encoded cropped video with digital rights management (DRM) security protections.

6. The method of claim 1 , wherein the primary display device comprises at least one selected from the list consisting of: a smart TV, a set top box (STB), and a video hub.

7. The method of claim 1 , further comprising:
receiving, at the primary display device from a third display device, a second request for a second viewpoint corresponding to a second tracked object or region selected from the plurality of tracked objects or regions in the video stream; and
responsive to the second request:
cropping the second tracked object or region of the second requested viewpoint from the decoded video stream to produce a second cropped video of the second requested viewpoint;
re-encoding the second cropped video; and
transmitting the re-encoded second cropped video to the secondary display device.

8. The method of claim 7 , wherein the second cropped video comprises an external content stream reference.

9. The method of claim 1 , further comprising:
at the primary display device, extracting a second region of interest from the video stream received,
wherein transmitting the options comprises transmitting an option for a cropped video cropped to the second region of interest.

10. The method of claim 1 , further comprising:
receiving, at the primary display device from the secondary display device, information related to local context or user preferences; and
responsive to receiving the information related to local context or user preferences, recommending at least one option of the options generated.

11. The method of claim 10 , further comprising:
creating a user profile from the information related to local context or user preferences,
wherein recommending the at least one option comprises using the user profile to recommend the at least one option.

12. The method of claim 10 , further comprising:
responsive to receiving the information related to local context or user preferences, limiting a number of options to request additional viewpoints.

13. The method of claim 1 , further comprising:
receiving, at the primary display device from the secondary display device, a request to follow a traced object,
wherein the cropped video comprises a cropped portion of the video stream received that includes the traced object.

14. A system comprising:
a receiver;
a display;
a processor; and
a non-transitory computer-readable medium storing instructions operative, when executed by the processor, to cause the system to:
receive an encoded video stream;
receive metadata identifying a plurality of tracked objects or regions in the encoded video stream;
decode the encoded video stream and display the decoded video stream at the primary display device;
generate options to request additional viewpoints corresponding to one or more of the plurality of tracked objects or regions, the options generated based on the metadata;
transmit the options to a secondary display device;
receive request for a viewpoint corresponding to a tracked object or region selected from the plurality of tracked objects or regions in the decoded video stream; and
responsive to the request:
crop the tracked object or region of the requested viewpoint from the decoded video stream to produce cropped video of the requested viewpoint;
re-encode the cropped video; and
transmit the re-encoded cropped video to the secondary display device.

15. A method of sharing media, the method comprising:
receiving, at a primary display device, an encoded video stream;
receiving, at the primary display device, metadata identifying a plurality of tracked objects or regions in the encoded video stream;
decoding the encoded video stream and displaying the decoded video stream at the primary display device;
generating options to request additional viewpoints corresponding to one or more of the plurality of tracked objects or regions, the options generated based on the metadata;
recommending at least one option of the options generated;
receiving, at the primary display device, a request for a viewpoint corresponding to a tracked object or region selected from the plurality of tracked objects or regions in the decoded video stream; and
responsive to the request:
cropping the tracked object or region of the requested viewpoint from the decoded video stream to produce cropped video of the requested viewpoint;
re-encoding the cropped video; and
transmitting the re-encoded cropped video.

16. The method of claim 15 ,
wherein recommending at least one option of the options generated comprises transmitting a recommendation to a secondary display device, and
wherein transmitting the re-encoded cropped video comprises transmitting the re-encoded cropped video to the secondary display device.

17. The method of claim 15 , further comprising:
receiving, at the primary display device from the secondary display device, information related to local context or user preferences,
wherein recommending the at least one option of the options generated is responsive to receiving the information related to local context or user preferences.

18. The method of claim 17 , further comprising:
creating a user profile from the information related to local context or user preferences,
wherein recommending the at least one option comprises using the user profile to recommend the at least one option.

19. The method of claim 17 , further comprising:
responsive to receiving the information related to local context or user preferences, limiting a number of options to request additional viewpoints.

20. The method of claim 15 , further comprising:
receiving, at the primary display device from the secondary display device, a request to follo

Assignees

• Interdigital Madison Patent Holdings Sas

Inventors

• Ojala Pasi Sakari

Classifications

• H04L65/613

  for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637) · CPC title

• H04N21/43637 Primary

  involving a wireless protocol, e.g. Bluetooth®, RF or wireless LAN [IEEE 802.11] (arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114) · CPC title

• H04N21/4728

  for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region · CPC title

• H04N21/6587

  Control parameters, e.g. trick play commands, viewpoint selection · CPC title

• H04N21/41265 Primary

  having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204) · CPC title