Configuration and operation of display devices including content curation

Patent metadata

Field	Value
Publication number	US-11853635-B2
Application number	US-201615283005-A
Country	US
Kind code	B2
Filing date	Sep 30, 2016
Priority date	Mar 9, 2016
Publication date	Dec 26, 2023
Grant date	Dec 26, 2023

Abstract

Content management includes receiving an image of one or more display devices with respective first content displayed. For at least one display device, a display device identification (ID) is retrieved. A change to the first content displayed at the at least one display device is caused, based on the display device ID of the at least one display device, upon interaction with the image.

First claim

What is claimed is:

1. A method for content management, comprising:
receiving, by an electronic device, a captured photo including images of an environment and one or more physical display devices with respective first content currently displayed;
on a user interface, overlaying each of the images of the one or more physical display devices in the captured photo with an outline region;
recognizing a displayed feature of the first content displayed on at least one physical display device;
identifying a display device of the at least one physical display device based on the recognized displayed feature of the first content, wherein the display device is identified using a plurality of physical markers disposed on a border of the one or more physical display devices;
controlling the first content displayed on the at least one physical display device comprising: selecting content matching one or more patterns in a pattern matching database in two or more portions of the first content; automatically overlaying box regions, by the electronic device, around the two or more portions; causing only the content within the box regions to currently be displayed on a selected one of the at least one physical display device and at least one other selected physical display device, upon interaction with the captured photo via the electronic device, wherein each of the two or more portions having less content than the first content.

2. The method of claim 1 , further comprising:
delineating regions, on the captured photo, via a computer vision technique, each region corresponding to a distinctive display device of the one or more physical display devices, wherein interaction with the captured photo including interaction with at least one of the one or more regions, and a display device identification (ID) is retrieved from a look up table that includes a relationship between the display device ID and currently displayed image.

3. The method of claim 1 , further comprising:
causing a second content to be sent to at least two display devices of the one or more physical display devices for display;
wherein the second content is displayed across the at least two display devices maintaining spatial relationship of the second content, and the outline region is on top of and encompasses each of the images of the one or more physical display devices in the captured photo.

4. The method of claim 2 , further comprising:
performing content recognition based on display device ID using computer vision, wherein an image identifier is stored for the displayed feature of the first content, and the plurality of physical markers provides for distinct identification of each display device of the one or more display devices using computer vision
wherein upon a particular box region changing by its corners being dragged, moved or scaled, the changes are tracked and a new position of the box region is recorded without losing display device association.

5. The method of claim 1 , wherein:
the one or more physical display devices are linked to a network;
recognizing the displayed feature comprises performing content recognition on the displayed feature based on pattern matching and accessing a pattern library; and
an image identifier is stored for the displayed feature of the first content prior to recognizing the displayed feature.

6. The method of claim 1 , further comprising:
analyzing features of the environment in the captured photo; and
mimicking the features of the environment for changing features of digital mat regions of the one or more physical display devices;

wherein the interaction with the captured photo is via the user interface supporting selection of display devices and interaction with the selected display devices, and recognizing the displayed feature comprises performing character recognition on the displayed feature.

7. The method of claim 1 , wherein
the user interface enables various gestures for managing content displayed on the one or more physical display devices, the displayed feature of the first content comprises a watermark marker, and an aspect ratio of each box region is always locked to that of a display device it is assigned to even when its scale changes.

8. The method of claim 1 , further comprising:
receiving a selection of a portion of an image of the first content;
receiving instructions to crop the portion; and
causing the cropped portion to be displayed in a selected display device of the one or more physical display devices;
wherein only the selected content within the box regions is displayed.

9. The method of claim 1 , further comprising:
receiving a selection of one or more portions of an image of the second content;
receiving cropping instructions to crop the one or more portions; and
causing the cropped one or more portions to be displayed across the at least two display devices;
wherein the box regions are user selectable for portions of the first content.

10. A device for content management comprising:
a memory storing instructions; and
at least one processor executing the instructions including a process configured to:
receive, by the device, a captured photo including images of an environment and one or more physical display devices with respective first content currently displayed;
on a user interface, overlay each of the images of the one or more physical display devices in the captured photo with an outline region;
recognize a displayed feature of the first content displayed on at least one physical display device;
identify a display device of the at least one physical display device based on the recognized displayed feature of the first content, wherein the display device is identified using a plurality of physical markers disposed on a border of the one or more physical display devices; and
control the first content currently displayed on the at least one physical display device comprising: selecting content matching one or more patterns in a pattern matching database in two or more portions of the first content; automatically overlaying box regions, by the device, around the two or more portions; causing only the content within the box regions to currently be displayed on a selected one of the at least one physical display device and at least one other selected physical display device, upon interaction with the captured photo via the device, wherein each of the two or more portions having less content than the first content.

11. The device of claim 10 , wherein the process is further configured to:
delineate regions, on the captured photo, via a computer vision technique, each region corresponding to a distinctive display device of the one or more physical display devices, wherein interaction with the captured photo including interaction with at least one of the one or more regions, a display device identification (ID) is retrieved from a look up table that includes a relationship between the display device ID and currently displayed image, and an image identifier is stored for the displayed feature of the first content.

12. The device of claim 10 , wherein the process is further configured to:
cause a second content to be sent to at least two display devices of the one or more physical display devices for display;
wherein:
the second content is displayed across the at least two display devices maintaining the spatial relationship of the second content;
the plurality of physical markers provides for distinct identification of each display device of the one or more display devices using computer vision;
an image identifier is stored for the displayed feature of the first content prior to recognition of th

Assignees

• Samsung Electronics Co Ltd

Inventors

• Yoganandan Arun Rakesh
• Akiyoshi Kumi
• Yang Melinda
• Hu Yuchang
• Schlager Mark

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06F3/1446 Primary

  display composed of modules, e.g. video walls · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F3/147

  using display panels · CPC title