Device for providing immersive content and method for providing immersive content

Patent metadata

Field	Value
Publication number	US-2025200902-A1
Application number	US-202218846590-A
Country	US
Kind code	A1
Filing date	Dec 8, 2022
Priority date	Apr 8, 2022
Publication date	Jun 19, 2025
Grant date	—

Abstract

Disclosed are a device for providing immersive content and a method thereof. The device for providing immersive content disclosed herein may comprise: a communication module configured to communicate with a cloud server and receive sensing data from one or more sensors disposed around a swimming pool; and memory for storing immersive content and 3D data related to same. In addition, the device can: recognize, on the basis of the sensing data received through the one or more sensors, the situation of a mobile object that has entered the vicinity of the swimming pool; and select immersive content related to the recognized situation of the mobile object and render the selected immersive content so as to output same as augmented reality on an underwater surface of the swimming pool. Here, the rendered immersive content is adaptively varied in response to changes in the situation of the mobile object.

First claim

1 . An immersive content providing device, the device comprising:
a communication module configured to communicate with a cloud server and receive sensing data from one or more sensors disposed in the vicinity of a swimming pool; a memory that stores immersive content and 3D data related thereto; and a processor that recognizes the situation of a mobile object that has approached the vicinity of the swimming pool based on sensing data received through the one or more sensors, selects immersive content related to the situation of the recognized mobile object, and renders the selected immersive content to be output in augmented reality on an underwater surface of the swimming pool, wherein the processor recognizes an approach location of the mobile object based on the sensing data, and renders and transmits responsive immersive content to be output as a 3D holographic image in a display area determined based on the approach location of the mobile object, wherein the processor renders the 3D holographic image to approach the location of the mobile object or to move according to the location of the mobile object.

2 . (canceled)

3 . The device of claim 1 , wherein when there are a plurality of mobile objects that have approached, the processor renders individual responsive immersive content items associated with respective mobile objects to be output in augmented reality based on respective locations of the plurality of mobile objects.

4 . The device of claim 1 , wherein the situation of the mobile object is related to one or more of a type of the recognized mobile object, a number of mobile objects, a location, a behavioral change, and whether personal information is linked thereto, and
wherein the processor selects immersive content associated therewith based on information collected from the cloud server and the situation of the mobile object.

5 . The device of claim 1 , wherein the one or more sensors comprise:
a vision sensor, an environmental sensor, and an audio sensor disposed outside the swimming pool, and a temperature sensor, an acceleration sensor, an ultrasonic sensor, and a water pressure sensor disposed inside the swimming pool.

6 . The device of claim 1 , wherein the processor monitors a behavioral change of the recognized mobile object based on the sensing data, and updates rendering to change immersive content that is output in real time on the basis of the monitoring result.

7 . The device of claim 1 , wherein the processor, when rendering immersive content related to the situation of the recognized mobile object at a certain location of a first display located on a side surface of the swimming pool and a second display located on a floor surface thereof, renders the content while varying the certain location according to a behavioral change of the recognized mobile object.

8 . (canceled)

9 . The device of claim 1 , wherein the processor, on the basis of the recognition of the approach of a mobile object based on sensing data received through the one or more sensors, links personal information through a sensor worn by the mobile object, and selects customized immersive content based on the linked personal information.

10 . The device of claim 1 , wherein the communication module collects the operation hours information of the swimming pool from the cloud server, and
wherein the processor determines different immersive content to be output in augmented reality on an underwater surface (floor, wall) of the swimming pool based on the collected operation hours information.

11 . The device of claim 1 , wherein the processor perceives a dangerous situation of a mobile object based on sensing data received from one or more sensors disposed in the vicinity of the swimming pool, and renders notification content to be displayed at a location related to the recognized dangerous situation.

12 . The device of claim 11 , wherein the processor, while the notification content is displayed at a location related to the recognized dangerous situation, controls the communication module to transmit a notification corresponding to the dangerous situation or controls an audio output device in the vicinity of the swimming pool to output a sound corresponding to the notification.

13 . A method of providing immersive content, the method comprising:
storing immersive content and 3D data related thereto in a memory; receiving sensing data from one or more sensors disposed in the vicinity of a swimming pool; recognizing the situation of a mobile object that has approached the vicinity based on the sensing data; selecting immersive content related to the situation of the recognized mobile object from the memory; and rendering the selected immersive content to be output in augmented reality on an underwater surface of the swimming pool, wherein the rendering step further comprises: recognizing an approach location of the mobile object based on the received sensing data; and rendering and transmitting responsive immersive content to be output as a 3D holographic image in a display area determined on the basis of the approach location of the mobile object, wherein the 3D holographic image is rendered to approach the location of the mobile object or to move according to the location of the mobile object.

14 . (canceled)

15 . The method of claim 13 , further comprising:
updating rendering, when there are a plurality of mobile objects that have approached, individual responsive immersive content items associated with respective mobile objects to be output in augmented reality on the basis of respective locations of the plurality of mobile objects.

16 . The method of claim 13 , wherein the situation of the mobile object is related to one or more of a type of the recognized mobile object, a number of mobile objects, a location, a behavioral change, and whether personal information is linked thereto, and
wherein the selecting step combines information collected from the cloud server with the situation of the mobile object to select immersive content associated therewith from the memory.

Assignees

• Lg Electronics Inc

Inventors

• Yang Jieun
• Choo Zhimin
• Hwang Inyoung
• Lee Kyoungha
• Shin Sungwon
• Jung Kwanju

Classifications

• G06T2207/20221

  Image fusion; Image merging · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T2219/2004

  Aligning objects, relative positioning of parts · CPC title

• G06T19/00 Primary

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title