Soundbar audio content control using image analysis

Patent metadata

Field	Value
Publication number	US-2016014540-A1
Application number	US-201514794565-A
Country	US
Kind code	A1
Filing date	Jul 8, 2015
Priority date	Jul 8, 2014
Publication date	Jan 14, 2016
Grant date	—

Abstract

A soundbar is described which includes a camera. The camera can be used to capture images of a listener as speakers of the soundbar output audio content to the listener. The captured images can be analysed to determine at least one characteristic of the listener (e.g. the age or gender of the listener). In one example, when the soundbar has determined a characteristic of the listener, the audio content outputted to the listener may be controlled based on the characteristic. In other examples, the images of the listener captured by the camera may be used to detect a response of the listener to media content which includes the audio content outputted from the soundbar. This response information may be combined with an indication of the characteristic of the listener in order to gather information relating to how different types of listeners respond to particular media content.

First claim

1 . A soundbar comprising:
a plurality of speakers configured to output audio content to a listener; a camera configured to capture images of the listener; and processing logic configured to:
(i) analyse the captured images to determine at least one characteristic of the listener; and
(ii) control the audio content outputted from the speakers to the listener based on the determined characteristic of the listener.

2 . The soundbar of claim 1 wherein the at least one characteristic of the listener comprises at least one of an age group of the listener and a gender of the listener.

3 . The soundbar of claim 1 wherein the processing logic is configured to analyse the captured images to determine at least one characteristic of the listener by using facial recognition to recognize the listener as one of a set of predefined listeners.

4 . The soundbar of claim 3 wherein each of the set of predefined listeners is associated with a content profile, wherein the processing logic is configured to control the audio content outputted from the speakers to the recognized listener in accordance with the content profile of the recognized listener.

5 . The soundbar of claim 4 wherein the content profile of a listener comprises at least one of:
(i) a volume range;
(ii) an audio style;
(iii) a language;
(iv) a video style;
(iv) one or more interests of the listener;
(v) an age;
(vi) a gender; and
(vii) restrictions to be applied to audio content.

6 . The soundbar of claim 1 wherein the soundbar is coupled to a display which is configured to output visual content in conjunction with the audio content outputted from the speakers of the soundbar.

7 . The soundbar of claim 6 wherein the soundbar is configured to provide the visual content to the display for output therefrom, wherein the processing logic is further configured to control the visual content provided to the display for output to the listener based on the determined at least one characteristic of the listener.

8 . The soundbar of claim 7 wherein the processing logic is configured to:
analyse the captured images to detect a gaze direction of the listener and to determine if the listener is looking in the direction of the display; and
control at least one of: (i) the audio content outputted from the speakers, and (ii) the visual content provided to the display, based on whether the listener is looking at the display.

9 . The soundbar of claim 1 wherein the processing logic is configured to analyse the captured images to:
determine that a plurality of listeners are present,
detect at least one characteristic of each of the plurality of listeners, and
control the audio content outputted from the speakers based on the detected at least one characteristic of the plurality of listeners.

10 . The soundbar of claim 9 wherein the processing logic is configured to separately control the audio content for different listeners.

11 . The soundbar of claim 4 wherein the processing logic is configured to separately control the audio content for different listeners, and wherein the processing logic is configured to:
use facial recognition to recognize the plurality of listeners as listeners of the set of predefined listeners; and
control the audio content outputted from the speakers to each of the plurality of listeners in accordance with their content profiles.

12 . A method of operating a soundbar comprising:
outputting audio content to a listener from a plurality of speakers of the soundbar; capturing images of the listener using a camera; analysing the captured images to determine at least one characteristic of the listener; and controlling the audio content outputted from the speakers of the soundbar to the listener based on the determined at least one characteristic of the listener.

13 . A soundbar comprising:
a plurality of speakers configured to output audio content to a listener; a camera configured to capture images of the listener; and processing logic configured to analyse the captured images to determine at least one characteristic of the listener and to detect a response of the listener to media content which includes audio content outputted from the speakers.

14 . The soundbar of claim 13 wherein the processing logic is configured to create a data item comprising: (i) an indication of the determined at least one characteristic, and (ii) an indication of the detected response of the listener to the media content.

15 . The soundbar of claim 14 further comprising a data store configured to store the data item.

16 . The soundbar of claim 14 further comprising an interface configured to enable the data item to be transmitted from the soundbar over the internet to a remote data store.

17 . The soundbar of claim 13 wherein the processing logic is configured to analyse the captured images to detect a response of the listener to media content which includes audio content outputted from the speakers by detecting a mood of the listener by either: (i) using facial recognition to identify facial features associated with particular moods, or (ii) analysing body language of the listener to identify body language traits associated with particular moods.

18 . The soundbar of claim 13 wherein the media content is associated with: (i) an advertisement, (ii) a news item, or (iii) an entertainment programme.

19 . The soundbar of claim 13 wherein the media content further includes visual content, and wherein the soundbar is coupled to a display which is configured to output the visual content in conjunction with the audio content outputted from the speakers of the soundbar, and wherein the processing logic is configured to detect a response of the listener by analysing the captured images to detect a gaze direction of the listener and to determine if the listener is looking in the direction of the display.

20 . The soundbar of claim 13 wherein the processing logic is configured to analyse the captured images to:
determine that a plurality of listeners are present,
detect at least one characteristic of each of the plurality of listeners, and
detect a response of each of the plurality of listeners to the media content which includes the audio content outputted from the speakers.

Assignees

• Imagination Tech Ltd

Inventors

• Kelly Alan
• Yassaie Hossein

Classifications

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• H04S7/303 Primary

  Tracking of listener position or orientation · CPC title

• H04N7/183

  for receiving images from a single remote source · CPC title

• H04R5/04

  Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)} · CPC title

• H04R2201/403

  Linear arrays of transducers · CPC title