Selective dynamic color management for user interface components of a media player

Patent metadata

Field	Value
Publication number	US-10134154-B2
Application number	US-201615395798-A
Country	US
Kind code	B2
Filing date	Dec 30, 2016
Priority date	Dec 30, 2016
Publication date	Nov 20, 2018
Grant date	Nov 20, 2018

Abstract

A user interface adaptation module identifies a dominant color of a portion selection of a frame of a video and, based on the dominant color, generates colors for components of a user interface in which the video is displayed. The colors of the user interface components are set based upon the generated colors and upon context information such as a playing state of the video. The setting of the component colors in this way allows the user interface to adjust to complement both the played content of the video and the video's context. In one embodiment, the dominant color is identified by partitioning individual pixels of the portion selection based on their respective colors. In one embodiment, a set of primary color variants is generated based on the dominant color, and different colors are generated for each type of user interface component based on the different primary color variants.

First claim

What is claimed is:

1. A computer-implemented method for setting colors of one or more user interface components in a user interface area of a video player to be visually harmonious with a playing video, the method comprising:
identifying a plurality of frames of the video;
for each frame of the identified frames:
determining a portion selection of the frame based on a position of the user interface area;
identifying a dominant color of the portion selection by:
partitioning colors of pixels of the portion selection into a plurality of color partitions,
identifying a color partition having a greatest number of the pixels of the portion selection, and
averaging color component values associated with each of the pixels of the identified color partition;

generating a plurality of color variants based on the dominant color by applying color parameters to color components of the dominant color; and
generating, for each of the color variants and for each of a plurality of user interface component types, a user interface component color;

identifying a playing state of the video, a current one of the identified frames before a current playing point in the video, and a next one of the identified frames after the current playing point in the video;
identifying first user interface component colors based on the playing state and on the user interface component colors generated for the current identified frame;
identifying second user interface component colors based on the playing state and on the user interface component colors generated for the next identified frame; and
setting one or more colors of the one or more user interface components of the video player based on the identified first user interface component colors and on the identified second user interface component colors.

2. A computer-implemented method comprising:
determining a portion selection of a frame of a video by determining a dimension of a user interface component display area comprising user interface components of a video user interface, determining a position of the user interface component display area, and selecting a portion of the frame of the video that is adjacent to the user interface component display area;
identifying a dominant color of the portion selection;
generating a plurality of color variants based on the dominant color;
identifying a playing state of the video;
selecting one of the color variants based on the playing state; and
setting one or more colors of one or more of the user interface components of the video user interface based on the selected color variant.

3. The computer-implemented method of claim 2 , wherein determining the portion selection of the frame of the video comprises a portion of the frame of the video that is adjacent to a user interface component display area comprising one or more of the user interface components of the video user interface.

4. The computer-implemented method of claim 2 , wherein
a dimension of the portion of the frame of the video is proportional to the dimension of the user interface component display area.

5. The computer-implemented method of claim 2 , wherein determining the portion selection of the video comprises identifying a semantic boundary of pixels of the frame of the video.

6. The computer-implemented method of claim 2 , wherein identifying the dominant color of a portion selection comprises:
partitioning colors of pixels of the portion selection into a plurality of color partitions;
identifying a color partition having a greatest number of the pixels of the portion selection; and
averaging color component values associated with each of the pixels of the identified color partition.

7. The computer-implemented method of claim 2 , wherein generating the plurality of color variants based on the dominant color comprises:
identifying color parameters corresponding to the color variants; and
applying the color parameters to color components of the dominant color.

8. The computer-implemented method of claim 2 , wherein the setting colors of the user interface components of the video user interface based on the selected color variant comprises:
generating, for each of a plurality of user interface component types, a user interface component color for each of the color variants; and
setting the colors of the video user interface using the user interface component colors for the color variant selected based on the playing state.

9. The computer-implemented method of claim 2 , further comprising determining a second dominant color, and a second plurality of color variants based on the second dominant color, for a second frame of the video.

10. The computer-implemented method of claim 9 , wherein setting the colors of the user interface components of the video user interface comprises:
identifying a current time within the playing of the video;
determining a first time difference of the current time from a time in the video corresponding to the first frame, and a second time difference of the current time from a time in the video corresponding to the second frame; and
interpolating user interface colors based on the first time difference, the second time difference, the dominant color, and the second dominant color.

11. A computer-implemented method comprising:
determining a portion selection of a frame of a video by: determining a dimension of the frame of the video; determining a position of a user interface component display area comprising user interface components of a video user interface; determining a dimension for the portion selection, the dimension for the portion selection proportional to the dimension of the frame of the video; and selecting a portion of the frame of the video that is adjacent to the user interface component display area, the portion of the frame having the dimension for the portion selection;
identifying a dominant color of the portion selection;
generating a plurality of color variants based on the dominant color;
identifying a playing state of the video;
selecting one of the color variants based on the playing state; and
setting one or more colors of one or more of the user interface components of the video user interface based on the selected color variant.

12. A non-transitory computer-readable storage medium storing instructions executable by a processor, the instructions comprising:
instructions for determining a portion selection of a frame of a video by determining a dimension of a user interface component display area comprising user interface components of a video user interface, determining a position of the user interface component display area, and selecting a portion of the frame of the video that is adjacent to the user interface component display area;
instructions for identifying a dominant color of the portion selection;
instructions for generating a plurality of color variants based on the dominant color;
instructions for identifying a playing state of the video;
instructions for selecting one of the color variants based on the playing state; and
instructions for setting one or more colors of one or more of the user interface components of the video user interface based on the selected color variant.

13. The non-transitory computer-readable storage medium of claim 12 , wherein determining the portion selection of the frame of the video comprises selecting a portion of the frame of the video that is adjacent to a user interface component display area comprising one or more of the user interface components of the video user interface.

14. The non-transitory computer-readable storage medium of claim 12 ,

Assignees

• Google Llc

Inventors

• Lee Eunjoo
• Kruge Nicholas Michael
• Kim Yong Hoon

Classifications

• H04N21/431 Primary

  Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering · CPC title

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G11B27/28

  by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} · CPC title

• G06T11/001 Primary

  Physics · mapped topic

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title