Methods and systems of dynamic content analysis

Patent metadata

Field	Value
Publication number	US-9678960-B2
Application number	US-201313903946-A
Country	US
Kind code	B2
Filing date	May 28, 2013
Priority date	Jan 31, 2013
Publication date	Jun 13, 2017
Grant date	Jun 13, 2017

Abstract

Methods and systems of dynamic content analysis for categorizing media contents are provided. Data regarding the media contents that a user is watching on one or more devices is obtained, and the environment in which the user is watching the media contents may be captured. Metadata categorizing the events and the media contents can be generated, and the metadata may be further associated with a corresponding event.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
obtaining data on media contents that is being sent to a set of devices, wherein the data comprises media signals delivered to at least one of the set of devices, wherein the media contents comprises a live broadcast, an unscripted media, or a combination of both;
processing, in real-time, the data to recognize dynamically one or more events happening within the media contents as the data is being sent to the set of devices, the processing comprising one or more of color tracing, scene recognition, facial expression detection and recognition, or a combination thereof, the events comprising one or more objects, persons, sounds, scene characteristics, or a combination thereof within the data being sent to the set of devices;
generating real-time content metadata categorizing the media contents based on the recognized events happening within the media contents, the real-time content metadata comprising one or more newly created metadata tags not previously associated with the data and describing the recognized events happening within the media contents;
associating the data with the real-time content metadata; and
generating and transmitting a request for supplementary information related to the media contents by using the real-time content metadata.

2. The computer-implemented method of claim 1 , further comprising receiving the supplementary information related to the media contents.

3. The computer-implemented method of claim 1 , further comprising:
receiving an instruction on obtaining the supplementary information related to the media contents; and
processing the instruction to obtain the supplementary information related to the media contents.

4. The computer-implemented method of claim 1 , wherein the supplementary information is related to a personal profile of the user, the method further comprising creating the personal profile associated with the user, the personal profile comprising a user's historical activity or a user's preference.

5. The computer-implemented method of claim 1 , wherein the real-time content metadata further describe an event, the real-time content metadata comprising a standardized event description to a natural language event description.

6. The computer-implemented method of claim 1 , wherein the supplementary information is further related to a concurrent activity of the user;
the method further comprising:
obtaining second data on the concurrent activity of the user; and
processing the second data to determine the concurrent activity of the user.

7. The computer-implemented method of claim 6 , wherein the concurrent activity comprises a facial expression of the user, a body movement of the user, a voice of the user, or an internet activity of the user.

8. The computer-implemented method of claim 6 , wherein the first user is a dominant user between the first user and a second user, the method further comprising:
obtaining second data on a second concurrent activity of a second user; and transcoding module; and
processing the second data to recognize a dominant user between the first user and the second user.

9. The computer-implemented method of claim 1 , wherein the step of processing the data comprises reading existing metadata encoded in a media signal and analyzing the existing metadata, and wherein the existing metadata comprises a closed caption, copy control information, or an operator watermark.

10. The computer-implemented method of claim 1 , wherein the step of processing the data comprises detecting an image or a sound of the media contents and analyzing the image or the sound detected.

11. A computer-implemented method, comprising:
receiving obtained data on media contents that is being sent to a set of devices from at least one of the set of devices, wherein the data comprises media signals delivered to at least one of the set of devices, wherein the media contents comprises a live broadcast, an unscripted media, or a combination of both;
processing, in real-time, the data to recognize dynamically one or more events happening within the media contents, the processing comprising one or more of color tracing, scene recognition, facial expression detection and recognition, or a combination thereof, the events comprising one or more objects, persons, sounds, scene characteristics, or a combination thereof within the data being sent to the set of devices;
generating real-time content metadata categorizing the media contents based on the dynamically recognized events happening within the media contents, the real-time content metadata comprising one or more newly created metadata tags not previously associated with the data and describing the recognized events happening within the media contents;
associating the data with the real-time content metadata; and
generating and transmitting a request for supplementary information related to the media contents by using the real-time content metadata.

12. The computer-implemented method of claim 11 , further comprising transmitting the supplementary information related to the media contents to the set of devices.

13. The computer-implemented method of claim 11 , further comprising:
determining an instruction on obtaining the supplementary information related to the media contents; and
transmitting the instruction to the set of devices.

14. The computer-implemented method of claim 11 , wherein the supplementary information is related to a personal profile of the user, the method further comprising creating the personal profile associated with the user, the personal profile comprising a user's historical activity or a user's preference.

15. The computer-implemented method of claim 11 , wherein the real-time content metadata further describe an event, the real-time content metadata comprising a standardized event description or a natural language event description.

16. The computer-implemented method of claim 11 , wherein the supplementary information is further related to a concurrent activity of the user; the method further comprising:
obtaining second data on the concurrent activity of the user; and
processing the second data to determine the concurrent activity of the user.

17. The computer-implemented method of claim 16 , wherein the concurrent activity comprises a facial expression of the user, a body movement of the user, a voice of the user, or an internet activity of the user.

18. The computer-implemented method of claim 16 , wherein the first user is a dominant user between the first user and a second user, the method further comprising:
obtaining second data on a second concurrent activity of a second user; and
processing the second data to recognize a dominant user between the first user and the second user.

19. The computer-implemented method of claim 18 , wherein the step of processing the data comprises reading existing metadata encoded in a media signal and analyzing the existing metadata, wherein the existing metadata comprises a closed caption, copy control information, or an operator watermark.

20. The computer-implemented method of claim 19 , wherein the step of processing the data comprises detecting an image or a sound of the media contents and analyzing the image or the sound detected.

21. An apparatus, comprising:
non-transitory memory storing a set of instructions; and
a processor coupled to the non-transitory, wherein the set of instructions are configured to cause the processor to:
obtain data on

Assignees

• Disney Entpr Inc

Inventors

• Robert Arnaud
• Arana Mark
• Drake Edward

Classifications

• G06F17/30032 Primary

  Physics · mapped topic

• H04N21/44226

  on social networks · CPC title

• H04N21/44224 Primary

  Monitoring of user activity on external systems, e.g. Internet browsing · CPC title

• H04N21/44222

  Analytics of user selections, e.g. selection of programmes or purchase activity (monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33) · CPC title

• G06F16/436

  using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures · CPC title