Live interactive video streaming using one or more camera devices

Patent metadata

Field	Value
Publication number	US-10219009-B2
Application number	US-201615355782-A
Country	US
Kind code	B2
Filing date	Nov 18, 2016
Priority date	Nov 18, 2016
Publication date	Feb 26, 2019
Grant date	Feb 26, 2019

Abstract

A computing device is configured to execute an interactive streaming application, and the interactive streaming application configured to join a live broadcast of an event that is shared by an interactive video broadcasting service executing on a server computer, receive a first video stream having video captured from a camera device configured as a first video source and display the video on a display screen, receive a second video stream having panoramic video captured from a panoramic video capturing device configured as a second video source and display a portion of the panoramic video according to a first viewing angle on the display screen, receive a change to the first viewing angle of the panoramic video, and display another portion of the panoramic video according to a second viewing angle.

First claim

What is claimed is:

1. A computing device comprising:
at least one processor; and
a non-transitory computer-readable medium having executable instructions that when executed by the at least one processor are configured to execute an interactive streaming application, the interactive streaming application configured to:
join a live broadcast of an event that is shared by an interactive video broadcasting service executing on a server computer;
receive a first video stream of the live broadcast, the first video stream having video captured from a camera device configured as a first video source;
display the video of the first video stream on a display screen of the computing device;
trigger display of a first icon and a second icon on the display screen during a course of the live broadcast, the first icon representing a first user-provided engagement provided by a first viewing device, the second icon representing a second user-provided engagement provided by a second viewing device, the first user-provided engagement being associated with a first timestamp in the first video stream such that the display of the first icon is triggered at a time indicated by the first timestamp, the second user-provided engagement being associated with a second timestamp in the first video stream such that the display of the second icon is triggered at a time indicated by the second timestamp,
wherein the first icon is removed from the display screen when a predetermined interval elapses after the time indicated by the first timestamp, and the second icon is removed from the display when a predetermined interval elapses after the time indicated by the second timestamp;
receive a second video stream of the live broadcast, the second video stream having panoramic video captured from a panoramic video capturing device configured as a second video source;
display a portion of the panoramic video according to a first viewing angle on the display screen;
receive a change to the first viewing angle of the panoramic video; and
display another portion of the panoramic video according to a second viewing angle, the second viewing angle providing a different perspective of the panoramic video than what was provided by the first viewing angle.

2. The computing device of claim 1 , wherein the panoramic video includes 360-degree video data.

3. The computing device of claim 1 , wherein the panoramic video capturing device includes a 360-degree camera mounted device.

4. The computing device of claim 1 , wherein the interactive streaming application is configured to receive an indication of a physical orientation of the computing device, and switch to the second viewing angle based on the indication.

5. The computing device of claim 1 , wherein the interactive streaming application is configured to receive a selection from a user interface of the interactive streaming application, and switch to the second viewing angle based on the selection.

6. The computing device of claim 1 , wherein the interactive streaming application is configured to receive a third video stream of the live broadcast, the third video stream having video captured from another camera device configured as a third video source, and display the video from the third video source on the display screen.

7. The computing device of claim 6 , wherein the interactive streaming application is configured to switch between displays of the first, second, and third video streams during the course of the live broadcast.

8. The computing device of claim 1 , wherein the interactive streaming application is configured to provide a multi-source display by concurrently providing the video from the camera device and the panoramic video from the panoramic video capturing device in separate areas of the display screen.

9. The computing device of claim 1 , wherein the panoramic video capturing device is a body-equipped 360-degree fly camera.

10. The computing device of claim 1 , wherein the interactive streaming application is configured to automatically select one of the first video stream and the second video stream based on a number of user-provided engagements received for the first video stream and a number of user-provided engagements received from the second video stream.

11. The computing device of claim 1 , wherein the interactive streaming application is configured to:
receive a selection of a replay of the first video stream, the replay including one or more video clips that capture past key activities of the event; and
initiate play back of the replay.

12. The computing device of claim 1 , wherein the first icon moves from a first location on the display screen to a second location on the display screen during the display of the first icon.

13. The computing device of claim 1 , wherein the removal of the second icon occurs after the removal of the first icon.

14. A system comprising:
at least one processor;
a non-transitory computer-readable medium having executable instructions that when executed by the at least one processor are configured to execute an interactive video broadcasting service, the interactive video broadcasting service configured to:
receive, over a network, a live broadcast of an event having video captured from a broadcasting device configured as a first video source for the event, and panoramic video captured from a panoramic video capturing device configured as a second video source for the event;
stream, over the network, the video of the first video source to a plurality of viewing devices that joined the live broadcast;
receive, over the network, an indication of a user-provided engagement from a first viewing device of the plurality of viewing devices;
provide, over the network, the indication of the user-provided engagement to the broadcasting device and a second viewing device of the plurality of viewing devices, the indication of the user-provided engagement being associated with a time in the video such that an icon representing the user-provided engagement is triggered to be displayed on the broadcasting device and the second viewing device based on the associated time;
stream, over the network, a first slice of the panoramic video to the plurality of viewing devices;
change a viewing angle of the panoramic video; and
stream, over the network, a second slice of the panoramic video to the plurality of viewing devices.

15. The system of claim 14 , wherein the panoramic video includes 360-degree video data.

16. The system of claim 14 , wherein the interactive video broadcasting service is configured to:
generate a replay of the live broadcast, the replay including one or more video clips that capture past key activities of the event; and
provide access to the replay such that the replay can be selected to view the past key activities of the event.

17. A method for sharing video within interactive video broadcasting service, the method including:
receiving, over a network, a live broadcast of an event having video captured from a camera device configured as a first video source for the event, and panoramic video captured from a panoramic video capturing device configured to a second video source for the event;
streaming, over the network, the video of the first video source to a plurality of viewing devices that joined the live broadcast;
providing, over the network, indications of first user-provided engagements to the plurality of viewing devices, the indications of the first user-provided engagements being associated with times in the video such that icons representing the first user-provided eng

Assignees

• Twitter Inc

Inventors

• Chang Wayne
• Sonwalkar Suyash

Classifications

• H04N23/63

  by using electronic viewfinders · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/662

  by using camera arrangements where one camera controls another camera to affect the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image · CPC title

• H04W84/042

  Public Land Mobile systems, e.g. cellular systems · CPC title

• H04N21/4788

  communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} · CPC title