Method and device for augmenting user-input information related to media content

Patent metadata

Field	Value
Publication number	US-10277933-B2
Application number	US-201213457534-A
Country	US
Kind code	B2
Filing date	Apr 27, 2012
Priority date	Apr 27, 2012
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

Disclosed is a method of augmenting user-input information that includes associating a first secondary device with primary media content, receiving user-input information input at the first secondary device, and analyzing the user-input information to identify user-content metadata. The method further includes at least one of: receiving primary-content metadata related to the primary media content and deriving primary-content metadata from the primary media content and identifying associations between the user-content metadata and the primary-content metadata.

First claim

We claim:

1. A method of augmenting user comments, the method comprising:
associating a first secondary device with a primary media device, the primary media device for displaying media content, and wherein the first secondary device comprises a secondary display device, a user interface for entering an input, and a client application for providing the user interface;
receiving, in the first secondary device, a user comment that is provided as the input at the first secondary device by a user of the first secondary device, wherein the input of the user comment is during and responsive to a display of a primary media content on the primary media device for viewing by the user;
analyzing the user comment to automatically generate user-content metadata comprising one or more of a keyword from the user comment and a key phrase from the user comment;
at least one of: receiving primary-content metadata related to the primary media content and deriving primary-content metadata from the primary media content,
wherein the primary-content metadata comprises information identifying a person speaking in the primary media content at a time of the display of the primary media content on the primary media device for viewing by the user, the time associated with the input of the user comment; and further comprises information spoken by the person during or proximate to the time; and

in one or more devices, using the user-content metadata and the primary-content metadata to automatically generate an identified association between the user comment and the primary-content metadata, the generating comprising analyzing the user-content metadata and the primary-content metadata to identify one or more associations between the user-content metadata and the primary-content metadata,
wherein the primary-content metadata comprises information relating to a specific viewable object displayed in a scene in the primary media content, and wherein the identified association includes information that relates the user comment to the specific viewable object displayed by the primary media device during the receiving of the user comment by the first secondary device.

2. The method of claim 1 wherein the specific viewable object displayed in a scene in the primary media content is one of: a person, a feature, an article, an item associated with a brand identity, an item associated with model information, an item associated with review information, an item associated with price information, an item associated with specifications information, an item of clothing, an item of food, a room, and a scene location.

3. The method of claim 1 further comprising enhancing viewable primary media content by displaying at least a part of the user comment along with the primary media content.

4. The method of claim 1 :
further comprising providing for display to a user of the first secondary device one or more of the identified associations;
wherein the user comment includes at least one of: a text-based and a voice-based user comment.

5. The method of claim 4 wherein deriving primary-content metadata is accomplished by at least one of: a server, the first secondary device, the primary media source, and the primary media device.

6. The method of claim 1 further comprising storing the identified associations for retrieval by a second secondary device separate from the first secondary device to which the user comment was first input.

7. The method of claim 6 further comprising viewing the identified associations on a user interface displayed on the first secondary device.

8. The method of claim 1 :
further comprising communicating at least a portion of the primary-content metadata from the first secondary device to a server;
wherein the primary-content metadata are derived from the primary media content provided at least in part by the first secondary device.

9. The method of claim 8 further comprising transmitting primary-content metadata to the first secondary device for association with user-content metadata.

10. A method of operating a first secondary device in a manner that complements operation of a primary media device for displaying media content, the method comprising:
establishing an association of the first secondary device with respect to the primary media device, wherein the first secondary device comprises a secondary display device, a user interface for entering a user comment, and a client application for providing the user interface;
receiving, in the first secondary device, the user comment that is provided to the first secondary device by a user of the first secondary device, wherein the user comment relates to a primary media content that is concurrently output by the primary media device for viewing by the user during the receiving;
analyzing the user comment, wherein the user comment comprises a user comment responsive to the output of the primary media content;
analyzing the primary media content; and
in one or more devices, automatically generating an identified association of the user comment, based at least on a first result from the analyzing of the user comment and a second result from the analyzing of the primary media content, wherein the first result comprises one or more of a keyword from the user comment and a key phrase from the user comment, and the second result comprises information relating to a specific viewable object displayed in a scene in the primary media content, to identify one or more associations between the user comment and the primary media content;
wherein the information relating to the specific viewable object comprises information identifying a person speaking in the primary media content at a time of the concurrent output of the primary media content on the primary media device for viewing by the user, the time associated with the receiving of the user comment; and further comprises information spoken by the person during or proximate to the time; and
wherein the identified association includes information that relates the user comment to the specific viewable object displayed by the primary media device during the receiving of the user comment by the first secondary device.

11. The method of claim 10 wherein analyzing the user comment includes identifying user-content metadata associated with the user comment.

12. The method of claim 11 wherein analyzing the primary media content includes at least one of: analyzing the primary media content to identify primary-content metadata associated with the primary media content and accessing pre-derived primary-content metadata.

13. The method of claim 12 wherein analyzing the user comment includes utilizing an extractor that extracts at least one keyword or key phrase from the user comment to form at least a part of the user-content metadata.

14. The method of claim 13 wherein analyzing the primary media content includes utilizing one or both of a media analyzer and an object detector to identify one or more of: an object, a location, speech, and text, to form at least a part of the primary-content metadata.

15. The method of claim 14 wherein identifying associations between the user comment and the primary media content includes identifying primary-content metadata that are similar to user-content metadata.

16. The method of claim 15 further comprising creating augmented user-input information by augmenting at least a portion of the user comment to include at least a portion of primary-content metadata that are associated therewith.

17. The method of claim 16 further comprising storing the augmented user-inpu

Assignees

• Venkitaraman Narayanan
• Basapur Santosh S
• Chaysinh Shirley A
• Lee Young S
• Mandalia Hiren M
• Arris Entpr Llc

Inventors

• Venkitaraman Narayanan
• Basapur Santosh S
• Chaysinh Shirley A
• Lee Young S
• Mandalia Hiren M

Classifications

• G06F17/3082

  Physics · mapped topic

• H04N21/4722

  for requesting additional data associated with the content · CPC title

• H04N21/4316

  for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window · CPC title

• G06F17/30817

  Physics · mapped topic

• H04N21/854

  Content authoring · CPC title