Image processing apparatus and method using smart glass

Patent metadata

Field	Value
Publication number	US-9460351-B2
Application number	US-201314035803-A
Country	US
Kind code	B2
Filing date	Sep 24, 2013
Priority date	Nov 28, 2012
Publication date	Oct 4, 2016
Grant date	Oct 4, 2016

Abstract

An image processing apparatus using a smart glass is provided, the image processing apparatus including an extractor to extract a first target to be observed by a user from a first image received from the smart glass and generate a second image using the extracted first target, an information collector to collect information related to the first target, and an image generator to reconstruct a third image using at least one of the second image and the information related to the first target, based on user settings.

First claim

What is claimed is:

1. An image processing apparatus using a smart glass, the apparatus comprising:
an extractor to extract a first target to be observed by a user from a first image received from the smart glass and generate a second image using the extracted first target;
an information collector to collect information related to the first target; and
an image generator to generate a third image using at least one of the second image and the information related to the first target, based on user settings in relation to the first target,
wherein, when the apparatus provides a time machine slow motion service to replay a scene having passed quickly in a perimeter of the user in a slow motion, the first target includes at least one of a sound, an event, and a predetermined time interval with respect to the first image, and the third image is a reconstructed image in a time machine slow motion and includes an automatic generation and indexing function with respect to a predetermined event desired by the user or a start event of the slow motion using sound recognition.

2. The apparatus of claim 1 , wherein the first target further comprises at least one of a motion, an object, and a predetermined person to be observed by the user.

3. The apparatus of claim 1 , wherein the first image is captured from a viewpoint corresponding to a gaze of the user.

4. The apparatus of claim 1 , wherein the second image in which an image quality with respect to a portion corresponding to the first target is greater than or equal to a first resolution, and an image quality with respect to a remaining portion excluding the first target is less than the first resolution, is generated.

5. The apparatus of claim 1 , wherein the extractor comprises:
a motion recognizer to recognize a predetermined motion of the user,
wherein the extractor provides the user with information related to the predetermined motion of the user.

6. The apparatus of claim 1 , wherein the image generator comprises:
a comparator to compare a previous image associated with the first target to the third image and provide a result of the comparing.

7. The apparatus of claim 1 , wherein the image generator recommends an image for each category of the information related to the first target, based on the information related to the first target.

8. The apparatus of claim 1 , wherein the third image comprises additional information provided using at least one of a graphic and a character.

9. The apparatus of claim 1 , wherein the smart glass comprises a depth camera or a 360-degree view angle camera, and is connected to the Internet.

10. The apparatus of claim 1 , wherein, when the apparatus further provides a synchronized multiple fitting service to enable the user to scan a list of clothes currently owned by the user through a mirror including the smart glass and to provide the user with information relating to the clothes, the first target includes at least one of a current appearance of the user, the list of clothes, a list of recommendations, and a previous image corresponding to a current season or weather information, and
wherein the image generator provides the user with fitting images moving in identical patterns for the user to compare an appearance in current clothes to an appearance in other clothes through the mirror, recommends an image for each category of the information related to the first target, and provides the user with the recommended image along with the third image.

11. An image processing method using a smart glass, the method comprising:
receiving a first image from the smart glass, and extracting a first target to be observed by a user from the first image;
generating a second image using the extracted first image;
collecting information related to the first target; and
generating a third image using at least one of the second image and the information related to the first target, based on user settings in relation to the first target,
wherein, when the method provides a time machine slow motion service to replay a scene having passed quickly in a perimeter of the user in a slow motion, the first target includes at least one of a sound, an event, and a predetermined time interval with respect to the first image, and the third image is a reconstructed image in a time machine slow motion and includes an automatic generation and indexing function with respect to a predetermined event desired by the user or a start event of the slow motion using sound recognition.

12. The method of claim 11 , wherein the first target further comprises at least one of a motion, an object, and a predetermined person to be observed by the user.

13. The method of claim 11 , wherein the first image is captured from a viewpoint corresponding to a gaze of the user.

14. The method of claim 11 , wherein the second image in which an image quality with respect to a portion corresponding to the first target is greater than or equal to a first resolution, and an image quality with respect to a remaining portion excluding the first target is less than the first resolution, is generated.

15. The method of claim 11 , further comprising:
comparing a previous image associated with the first target to the third image and providing a result of the comparing on one side of the third image.

16. The method of claim 11 , further comprising:
providing a recommended image for each category of the information related to the first target on one side of the third image.

17. The method of claim 11 , wherein, when the method further provides a synchronized multiple fitting service, the method further comprises:
enabling the user to scan a list of clothes currently owned by the user through a mirror including the smart glass;
providing the user with information relating to the clothes;
providing the user with fitting images moving in identical patterns for the user to compare an appearance in current clothes to an appearance in other clothes through the mirror;
recommending an image for each category of the information related to the first target; and
providing the user with the recommended image along with the third image,
wherein the first target includes at least one of a current appearance of the user, the list of clothes, a list of recommendations, and a previous image corresponding to a current season or weather information.

18. An image processing apparatus using a smart glass, the apparatus comprising:
an extractor to extract a first target to be observed by a user from a first image received from the smart glass and generate a second image using the extracted first target;
an information collector to collect information related to the first target; and
an image generator to generate a third image using at least one of the second image and the information related to the first target, based on user settings in relation to the first target,
wherein, when the apparatus provides a virtual coexistence remote tour service to enable an image captured using the smart glass in a second place to be viewed identically in a first place and to provide the user in the first place with an effect similar to being in the second place, the first image refers to an image captured from a viewpoint corresponding to a gaze of the user with respect to the second place and the first target includes a predetermined scene or a landscape of the second place, and
wherein, for an augmented reality sharing function between user smart glasses of the first place and the second place, the third image represents a facial expression or a mo

Assignees

• Electronics & Telecommunications Res Inst

Inventors

• Kim Kwi Hoon
• You Woong Shik
• Bae Jae Hwui
• Ahn Sang Woo
• Kwon O Hyung

Classifications

• H04N7/147

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• H04N2007/145

  Handheld terminals · CPC title

• H04N21/21805

  enabling multiple viewpoints, e.g. using a plurality of cameras · CPC title

• G06F3/1454

  involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay · CPC title

• G01S17/86

  Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders · CPC title