Information processing device, information processing method, information provision device, and information provision system

Patent metadata

Field	Value
Publication number	US-10477267-B2
Application number	US-201214348960-A
Country	US
Kind code	B2
Filing date	Aug 27, 2012
Priority date	Nov 16, 2011
Publication date	Nov 12, 2019
Grant date	Nov 12, 2019

Abstract

An ACR service is realized by an information provision server which has not prepared feature point information of a sub sound because only the feature point information is extracted from a main sound and an inquiry is made to the information provision server even when the sub sound is listened to in a client device. In addition, even when content that has a main sound and a plurality of pieces of audio information is distributed, it is not necessary for the information provision server to prepare feature point information of sub sounds, and the capacity of the database may not increase.

First claim

The invention claimed is:

1. An information processing device comprising:
circuitry to
receive input content including a main sound stream and a sub sound stream;
output a sound by separately decoding and reproducing either the main sound stream or the sub sound stream included in the input content; and
generate feature point information from the main sound stream irrespective of whether the main sound stream is decoded and reproduced to output the sound, wherein

when an automatic content recognition operation is performed while the sound being output is not from the main sound stream, the circuitry decodes the main sound stream and generates the feature point information to be used in the automatic content recognition operation from a decoding result of the main sound stream,
the circuitry further identifies the input content based on the feature point information generated from the main sound stream, and
the circuitry is further connected to a network, and checks a reference feature point information database in which content identification information is associated with the feature point information of the main sound stream included in the content, thereby acquiring the content identification information.

2. The information processing device according to claim 1 , wherein the circuitry generates the feature point information when the automatic content recognition operation is performed irrespective of which one of the main sound stream and the sub sounds stream is decoded and reproduced to output the sound.

3. The information processing device according to claim 1 , wherein
the content input to the circuitry is multiplexed with an image, and
the circuitry further
demultiplexes the input content,
performs a process targeting all sound streams, including the main sound stream and the sub sound stream, included in the content,
outputs the sound by decoding and reproducing only the sound stream to be listened to among the demultiplexed main sound stream and the sub sound stream, and
decodes the demultiplexed main sound stream and generates the feature point information from the decoding result of the main sound stream, when the automatic content recognition operation is performed when the sub sound stream is listened to.

4. The information processing device according to claim 1 , wherein the circuitry further acquires relevant information of the content by checking a relevant information database in which relevant information of each piece of content is stored.

5. The information processing device according to claim 1 , wherein
the main sound stream and the sub sound stream are represented by two separate elementary streams extracted by a demultiplexer.

6. The information processing device according to claim 1 , wherein the circuitry receives from a server, metadata associated with the input content upon transmitting the generated feature point information to the server.

7. The information processing device according to claim 1 , wherein the circuitry generates the feature point information from only the main sound stream irrespective of which one of the main sound stream and the sub sound stream is decoded and reproduced to output the sound.

8. The information processing device according to claim 1 , wherein the sound is output by separately decoding and reproducing only one of the main sound stream and the sub sound stream.

9. The information processing device according to claim 1 , wherein the automatic content recognition operation identifies the input content based on the feature point information generated from the main sound stream.

10. An information processing method comprising:
receiving input content including a main sound stream and a sub sound stream;
outputting a sound by separately decoding and reproducing either the main sound stream or the sub sound stream included in the input content; and
generating, by circuitry of an information processing device, feature point information from the main sound stream irrespective of whether the main sound stream is decoded and reproduced to output the sound, wherein
when an automatic content recognition operation is performed while the sound being output is not from the main sound stream, the generating includes decoding the main sound stream and generating the feature point information to be used in the automatic content recognition operation from a decoding result of the main sound stream,
the method further includes identifying the input content based on the feature point information generated from the main sound stream, and
the circuitry of the information processing device is further connected to a network, and checks a reference feature point information database in which content identification information is associated with the feature point information of the main sound stream included in the content, thereby acquiring the content identification information.

11. An information provision system comprising:
a content distribution device including first circuitry to distribute content including a main sound stream and a sub sound stream;
a client device including second circuitry to present the content distributed from the content distribution device with the main sound stream or the sub sound stream, and to generate feature point information from the main sound stream irrespective of whether the main sound stream is presented with the content; and
an information provision server to include a reference feature point information database in which the feature point information generated from the main sound stream of the content is associated with content identification information, and to provide the content identification information corresponding to an inquiry of the feature point information from the client device, wherein
when an automatic content recognition operation is performed while the sub sound stream is, and the main sound stream is not, presented with the content, the second circuitry decodes the main sound stream and generates the feature point information to be used in the automatic content recognition operation from a decoding result of the main sound stream,
the second circuitry further identifies the content based on the feature point information generated from the main sound stream, and
the second circuitry is further connected to a network, and checks the reference feature point information database, thereby acquiring the content identification information.

Assignees

• Nakamura Hitoshi
• Saturn Licensing Llc

Inventors

• Nakamura Hitoshi

Classifications

• H04N21/4394 Primary

  involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58) · CPC title

• G06F21/16

  Program or content traceability, e.g. by watermarking · CPC title

• H04N21/8358

  involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)} · CPC title

• H04N21/233

  Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)} · CPC title

• H04N21/23892

  involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level · CPC title