Device and method to display object with visual effect

Patent metadata

Field	Value
Publication number	US-11200746-B2
Application number	US-202016782518-A
Country	US
Kind code	B2
Filing date	Feb 5, 2020
Priority date	Jul 8, 2014
Publication date	Dec 14, 2021
Grant date	Dec 14, 2021

Abstract

A display method includes displaying, in a virtual environment, an object to which a light source is set. The method further includes illuminating an area around the object based on the light source.

First claim

What is claimed is:

1. A display method comprising:
displaying, in a virtual environment, an object in a position where a plurality of virtual light sources are set or in the position where the object is set to be displayed;
extracting, from the object, color values around positions of the plurality of virtual light sources; and
illuminating an area around the displayed object using the plurality of virtual light sources to which the color values are applied,
wherein an illumination effect of the plurality of virtual light sources is excluded on the object itself and a light amount of the illumination effect decreases as a distance becomes further away from a position of the plurality of virtual light sources,
wherein information of the plurality of virtual light sources are automatically set and the information of the plurality of virtual light sources include the positions, an intensity attenuation and an interval between each pair of the plurality of virtual light sources, and
wherein the positions of plurality of virtual light sources are set in a grid form on an object area of the object.

2. The method of claim 1 , wherein the positions of the plurality of virtual light sources are set at predetermined intervals within the object.

3. The method of claim 1 , wherein the extracting comprises:
extracting, from the object as the color values, one of an average value, a weighted average value, and a median value of color values around the positions of the plurality of virtual light sources.

4. The method of claim 1 , wherein the illuminating comprises:
controlling either one or both of a level of the illumination of the area, and a size of the illuminated area, in response to a control signal.

5. The method of claim 1 , wherein the object comprises either one or both of a still image object and a video object.

6. A display method comprising;
displaying, in a virtual environment, an object in a position where a plurality of virtual light sources are set or in the position where the object is set to be displayed;
extracting, from the object, color values around positions of the plurality of virtual light sources; and
illuminating an area around the displayed object using the plurality of virtual light sources to which the color values are applied,
wherein an illumination effect of the plurality of virtual light sources is excluded on the object itself and a light amount of the illumination effect decreases as a distance becomes further away from a position of the plurality of virtual light sources, and
wherein the plurality of virtual light sources comprise either spot lights or point lights, and in response to a virtual light source of the plurality of virtual light sources being a spot light, setting an illuminating orientation, a position, a cut-off angle, and an intensity attenuation of the virtual light source, based on the illuminating orientation.

7. The method of claim 6 , wherein the illuminating comprises:
calculating the area based on the illuminating orientation and the cut-off angle.

8. A display device, comprising:
a display; and
a processor configured to:
display, in a virtual environment on the display, an object in a position where a plurality of virtual light sources are set or in the position where the object is set to be displayed,
extract color values of pixels for portions of the object, and
illuminate, on the display, an area around the object using the plurality of virtual light sources to which the color values are applied,
wherein an illumination effect of the plurality of virtual light sources is excluded on the object itself and a light amount of the illumination effect decreases as a distance becomes further away from a position of the plurality of virtual light sources,
wherein information of the plurality of virtual light sources are automatically set and the information of the plurality of virtual light sources include positions, an intensity attenuation and an interval between each air of the plurality of virtual light sources, and
wherein the positions of plurality of virtual light sources are set in a grid form on an object area of the object.

9. The display device of claim 8 , wherein the processor is further configured to:
set any one or any combination of an illuminating orientation, a position, a cut-off angle, and the intensity attenuation of the plurality of virtual light sources in response to the plurality of virtual light sources being spot lights.

10. The display device of claim 9 , wherein the processor is configured to:
calculate the area based on any one or any combination of the illuminating orientation, the position, the cut-off angle, and the intensity attenuation.

11. The display device of claim 8 , wherein the processor is configured to:
extract, from the object as the color values, one of an average value, a weighted average value, and a median value of color values around the position of the plurality of virtual light sources.

12. The display device of claim 8 , wherein the processor is further configured to:
control a level of the illumination of the area in response to a control signal.

13. The display device of claim 8 , wherein:
the object comprises a video object;
the virtual environment comprises a virtual space in which the video object is provided; and
the processor is further configured to apply, to the plurality of virtual light sources, a color of a position of the plurality of virtual light sources in a frame per frame of the video object.

14. The display device of claim 8 , wherein:
the object comprises a photo object;
the virtual environment comprises a virtual space in which the photo object is provided based on a predetermined arrangement; and
the processor is further configured to illuminate, on the display, the virtual space based on the set plurality of virtual light sources.

15. The display device of claim 8 , wherein the processor is further configured to:
set a brightness of the plurality of virtual light sources set to the position of the object of objects in the virtual environment to be brighter than a brightness of another virtual light source set to a position of another object of the objects.

16. The display device of claim 8 , wherein the display comprises any one or any combination of a head mounted display, a stereoscopic display, and a touch screen.

17. A display device comprising:
a display configured to display, in a virtual environment, an image comprising an object;
an interface configured to receive an input; and
a processor configured to:
maintain an illumination effect on the object, and change an illumination effect on surroundings of the object, in response to the input, wherein the illumination effect on the surroundings is generated by
displaying, on the display in the virtual environment, the object in a position where a plurality of virtual light sources are set or in the position where the object is set to be displayed,
extracting color values of pixels for portions of the object, and
illuminating, on the display, an area around the object using the plurality of virtual light sources to which the color values are applied,
wherein an illumination effect of the plurality of virtual light sources is excluded on the object itself and a light amount of the illumination effect decreases as a distance becomes further away from a position of the plurality of virtual light sources,
wherein information of the plurality of virtual light sources are automatically set and the information of the plurality of virtual light sources

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Keechang
• Ahn Minsu
• Ha Inwoo
• Park Seungin
• Lee Hyong Euk
• Lee Heesae

Classifications

• G06F3/04815 Primary

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06T15/506

  Illumination models · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T2219/2012

  Colour editing, changing, or manipulating; Use of colour codes · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title