Wearable device for identifying area for displaying image and method thereof

Patent metadata

Field	Value
Publication number	US-12561933-B2
Application number	US-202418921147-A
Country	US
Kind code	B2
Filing date	Oct 21, 2024
Priority date	Mar 21, 2023
Publication date	Feb 24, 2026
Grant date	Feb 24, 2026

Abstract

According to an embodiment, a processor of a wearable device displays a virtual object superimposed on a virtual space by using a display. The processor receives an input for rotating a dial in a first direction while the superimposed virtual object is displayed in the virtual space. While the input is maintained, the processor reduces a first area in which the virtual space is displayed. While the input is maintained, the processor maintains a size of the virtual object that is superimposed on the virtual space and is displayed inside of the first area reduced while the input is maintained. While the input is maintained, the processor expands a second area including the image that is further displayed on the display in response to the input.

First claim

What is claimed is:

1 . A wearable device, comprising:
one or more cameras; at least one display; memory storing instructions, comprising one or more storage mediums; and at least one processor comprising processing circuitry, wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable device to:
obtain a real space image using the one or more cameras;
display a virtual environment on the at least one display;
while displaying the virtual environment, identify an external object included in the real space image;
based on identifying the external object, determine a first area in the virtual environment for displaying a portion of the real space image corresponding to the identified external object;
concurrently display the virtual environment and the portion of the real space image corresponding to the external object, wherein the portion of the real space image is displayed at the determined first area with a first transparency;
track movement of the external object from the real space image;
based on the tracked movement of the external object, determine a second area for displaying a portion of the real space image corresponding to the moved external object in the virtual environment; and
based on the determined second area, concurrently display the virtual environment and the portion of the real space image corresponding to the moved external object, wherein the portion of the real space image is displayed at the determined second area with the first transparency.

2 . The wearable device of claim 1 , wherein the external object is positioned within a reference distance from the wearable device.

3 . The wearable device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable device to:
display, within the first area, the portion of the real space image corresponding to the external object; and display, within a remaining area with respect to the first area, the virtual environment.

4 . The wearable device of claim 1 , wherein the one or more cameras comprise one or more first cameras further comprising:
one or more second cameras; wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable device to:
identify a gaze direction using the one or more second cameras; and
based on the gaze direction directed to the displayed portion of the real space image, change a transparency of the portion of the real space image from the first transparency to a second transparency.

5 . The wearable device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable device to:
display, within the first area, the portion of the real space image, which corresponds to the at least a portion of the external object, by segmenting the real space image, wherein the first transparency used to display the portion of the real space image is changed to a second transparency in accordance with a user input with respect to the portion of the real space image.

6 . The wearable device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable device to:
change a transparency of the virtual environment displayed within the first area, from a third transparency to a fourth transparency, to concurrently display the virtual environment and the portion of the real space image.

7 . The wearable device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable device to:
change a transparency of the virtual environment displayed within the second area, from a third transparency to a fourth transparency, to concurrently display the virtual environment and the portion of the moved external object.

8 . The wearable device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable device to:
while displaying the virtual environment, identify the external object included in the real space image by identifying a visual object included in the real space image, wherein the visual object corresponds to a predetermined object or an object designated by a user.

9 . The wearable device of claim 1 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable device to:
determine the first area for displaying the portion of the real space image by determining a shape or a size of the external object depicted in the real space image.

10 . A method of a wearable device, wherein the wearable device comprises one or more cameras, and at least one display, comprising:
obtaining a real space image using the one or more cameras; displaying a virtual environment on the at least one display; while displaying the virtual environment, identifying an external object included in the real space image; based on identifying the external object, determining a first area in the virtual environment for displaying a portion of the real space image corresponding to the identified external object; concurrently displaying the virtual environment and the portion of the real space image corresponding to the external object, wherein the portion of the real space image is displayed at the determined first area with a first transparency; tracking movement of the external object from the real space image; based on the tracked movement of the external object, determining a second area for displaying a portion of the real space image corresponding to the moved external object in the virtual environment; and based on the determined second area, concurrently displaying the virtual environment and the portion of the real space image corresponding to the moved external object, wherein the portion of the real space image is displayed at the determined second area with the first transparency.

11 . The method of claim 10 , wherein the external object is positioned within a reference distance from the wearable device.

12 . The method of claim 10 , wherein the displaying the virtual environment and the at least portion of the external object comprises:
displaying, within the first area, the portion of the real space image corresponding to the external object; and displaying, within a remaining area with respect to the first area, the virtual environment, wherein the first transparency used to display the portion of the real space image is changed to a second transparency in accordance with a user input with respect to the portion of the real space image.

13 . The method of claim 10 , wherein the displaying the virtual environment and the portion of the real space image comprises:
displaying, within the second area, the portion of the real space image corresponding to the moved external object; and displaying, within a remaining area with respect to the second area, the virtual environment.

14 . The method of claim 10 , wherein the displaying the virtual environment and the portion of the real space image comprises:
displaying, within the first area, the portion of the real space image, which correspond to the at least a portion of the external object, by segmenting the real space image.

15 . A non-transitory computer readable storage medium storing instructions, wherein the instructions, when executed by a wearable device comprising one or more cameras, and at least one display, cause t

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Eunbin
• Nam Myoungwoo
• Park Eunyoung
• Son Dongil
• Ahn Stephanie
• Lee Bona
• Chung Miyeoung

Classifications

• G06T2210/62

  Semi-transparency · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06F3/0362

  with detection of one-dimensional [1D] translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts · CPC title

• G06V20/20

  in augmented reality scenes · CPC title