Personalized sensitivity measurements and playback factors for adaptive and personalized media coding and delivery

Patent metadata

Field	Value
Publication number	US-11863839-B2
Application number	US-202017632465-A
Country	US
Kind code	B2
Filing date	Jul 30, 2020
Priority date	Aug 2, 2019
Publication date	Jan 2, 2024
Grant date	Jan 2, 2024

Abstract

A method for delivering media to a playback device including outputting first test media to be viewed by a first user. The method further includes receiving a first user input related to a first perception of the first test media by the first user and indicating a first personalized quality of experience of the first user with respect to the first test media. The method further includes generating a first personalized sensitivity profile including one or more viewing characteristics of the first user based on the first user input, and determining, based at least in part on the first personalized sensitivity profile, a first media parameter. The first media parameter is determined in order to increase an efficiency of media delivery to the first playback device over a network while preserving the first personalized quality of experience of the first user.

First claim

What is claimed is:

1. A method for delivering media to a playback device, the method comprising:
outputting, by a first playback device and during a first test measurement session, first test media to be viewed by a first user;
receiving a first user input from the first user, the first user input related to a first perception of the first test media by the first user and indicating a first personalized quality of experience of the first user with respect to the first test media;
generating, with one or more electronic processors, a first personalized sensitivity profile including one or more viewing characteristics of the first user and/or of an environment in which the first user is viewing the first playback device based on the first user input;
determining, with the one or more electronic processors and based at least in part on the first personalized sensitivity profile, a first media parameter for increasing an efficiency of media delivery to the first playback device over a network while preserving the first personalized quality of experience of the first user; and
providing, by a media server over the network, first output media to the first playback device in accordance with the first media parameter, the first output media configured to be output with the first playback device,
wherein the first test media includes a plurality of hybrid images and the first user input includes a plurality of user inputs, each of the first user inputs being received in response to a respective hybrid image of the plurality of hybrid images, and
wherein determining the first media parameter includes:
retrieving, with the one or more electronic processors and from a memory, a generic objective model configured to control media streaming based on at least one of resource availability of the network and playback system parameters;
transforming, with the one or more electronic processors, the generic objective model into a personalized objective model using the first personalized sensitivity profile; and
providing, by the media server over the network, the first output media to the first playback device in accordance with the personalized objective model.

2. The method of claim 1 , wherein providing the first output media to the first playback device in accordance with the first media parameter results in the network using decreased bandwidth to provide the first output media to the first playback device without reducing the first personalized quality of experience of the first user.

3. The method of claim 1 , further comprising:
outputting, by a second playback device and during a second test measurement session, second test media to be viewed by a second user;
receiving a second user input from the second user, the second user input related to a second perception of the second test media by the second user and indicating a second personalized quality of experience of the second user with respect to the second test media, wherein the second personalized quality of experience indicates that the second user is more sensitive to decreases in quality of media than the first user of the first playback device;
generating, with the one or more electronic processors, a second personalized sensitivity profile of one or more viewing characteristics of the second user and/or of an environment in which the second user is viewing the second playback device based on the second user input;
determining, with the one or more electronic processors, a second media parameter for the second playback device based at least in part on the second personalized sensitivity profile;
providing, with the one or more electronic processor and over the network, second output media to the second playback device in accordance with the second media parameter, the second output media configured to be output with the second playback device;
wherein the first media parameter and the second media parameter are determined such that providing of the first output media to the first playback device decreases a first usage of resources of the network to be lower than a second usage of resources of the network with respect to providing of the second output media to the second playback device; and
wherein a first percentage of the first personalized quality of experience of the first user is maintained at approximately the same level as a second percentage of the second personalized quality of experience of the second user.

4. The method of claim 3 , wherein the one or more electronic processors includes at least one of a first electronic processor of the first playback device, a second electronic processor of the second playback device, and a third electronic processor associated with the network or the media server.

5. The method of claim 1 , further comprising:
generating, with the one or more electronic processors, each hybrid image by low-pass filtering a first source image to create a low-pass filtered source image, high-pass filtering a second source image to create a high-pass filtered source image, and
overlaying the low-pass filtered source image and the high-pass filtered source image on top of each other to create the hybrid image;
wherein either the low-pass filtered source image or the high-pass filtered source image is perceived by the first user as dominant depending on the one or more viewing characteristics of the first user and/or of the environment.

6. The method of claim 5 , wherein outputting the first test media includes:
outputting, by the first playback device, a first hybrid image to be viewed by the first user;
receiving the first user input from the first user, the first user input related to the first perception of the first hybrid image by the first user; and
outputting, by the first playback device, a second hybrid image to be viewed by the first user, wherein a cutoff frequency of at least one of the low-pass filtering and the high-pass filtering used to create the second hybrid image is based on the first user input related to the first perception of the first hybrid image by the first user.

7. The method of claim 1 , wherein outputting the first test media includes:
retrieving, with the one or more electronic processors and from a memory, a previously-stored personalized sensitivity profile; and
generating, with the one or more electronic processors, the first test media based on one or more viewing characteristics included in the previously-stored personalized sensitivity profile.

8. The method of claim 7 , wherein retrieving the previously-stored personalized sensitivity profile includes:
determining, with the one or more electronic processors, a characteristic of the first test measurement session including at least one of a characteristic of the first user, a characteristic of the first playback device, and a characteristic of the environment in which the first user is viewing the first playback device; and
identifying, with the one or more electronic processors, the previously-stored personalized sensitivity profile from a plurality of previously stored personalized sensitivity profiles based on the previously-stored personalized sensitivity profile including one or more of the same characteristics as the characteristic of the first test measurement session.

9. The method of claim 1 , wherein transforming the generic objective model into the personalized objective model includes at least one of translating and scaling an ideal contrast sensitivity function (CSF) used by the generic objective model to create a personalized CSF based on the first personalized sensitivity profile.

10. The method of claim 1 , wherein the one or more viewing characteristics of the first user and/or of the environment include at

Assignees

• Dolby Laboratories Licensing Corp

Inventors

• Kim Doh-Suk
• Mccarthy Sean Thomas
• Daly Scott
• Riedmiller Jeffrey
• Malfait Ludovic Christophe
• Ullmann Raphael Marc
• Cloud Jason Michael

Classifications

• H04N21/64769 Primary

  for rate control (flow control in packet networks H04L47/10) · CPC title

• H04L65/80 Primary

  Responding to QoS · CPC title

• H04N21/2668

  Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)} · CPC title

• H04N21/4532

  involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18) · CPC title

• G06F16/435 Primary

  Filtering based on additional data, e.g. user or group profiles · CPC title