Information processing device, information processing method, and recording medium

Patent metadata

Field	Value
Publication number	US-2025159425-A1
Application number	US-202318839439-A
Country	US
Kind code	A1
Filing date	Feb 27, 2023
Priority date	Mar 15, 2022
Publication date	May 15, 2025
Grant date	—

Abstract

There is provided an information processing device, an information processing method, and a recording medium that enable sharing of attention of users existing in a wide area. The information processing device includes a control unit that performs control of spatial localization of an audio of another user except a target user on the basis of information regarding at least one of a view direction of a first user corresponding to a captured image captured by an imaging device provided for the first user or a view direction of a second user who views a surrounding captured image in which surroundings of a position where the first user exists are captured as the captured image. The present disclosure can be applied to, for example, devices constituting a system that shares view information.

First claim

1 . An information processing device comprising:
a control unit configured to perform control of spatial localization of an audio of another user except a target user on a basis of information regarding at least one of a view direction of a first user corresponding to a captured image captured by an imaging device provided for the first user or a view direction of a second user who views a surrounding captured image in which surroundings of a position where the first user exists are captured as the captured image.

2 . The information processing device according to claim 1 , wherein,
in a case where the target user is the first user and the another user is the second user, when a change in the view direction of the first user is detected, the control unit rotationally corrects the surrounding captured image and the audio of the second user in a direction of offset in accordance with a rotation amount according to the detected change in the view direction of the first user.

3 . The information processing device according to claim 2 , wherein,
when a change in the view direction of the second user is detected, the control unit rotationally corrects the audio of the second user in accordance with a rotation amount according to the detected change in the view direction of the second user.

4 . The information processing device according to claim 1 , wherein,
in a case where the target user is the second user and the another user is the first user, when a change in the view direction of the first user is detected, the control unit rotationally corrects the audio of the first user in accordance with a rotation amount according to the detected change in the view direction of the first user.

5 . The information processing device according to claim 4 , wherein,
when a change in the view direction of the second user is detected, the control unit rotationally corrects the audio of the first user in a direction of offset in accordance with a rotation amount according to the detected change in the view direction of the second user.

6 . The information processing device according to claim 1 , wherein,
in a case where the target user is the second user and the another user is another second user different from the second user, when a change in the view direction of the second user is detected, the control unit rotationally corrects the audio of the another second user in a direction of offset in accordance with a rotation amount according to the detected change in the view direction of the second user.

7 . The information processing device according to claim 6 , wherein,
when a change in the view direction of the another second user is detected, the control unit rotationally corrects the audio of the another second user in accordance with a rotation amount according to the detected change in the view direction of the another second user.

8 . The information processing device according to claim 1 , wherein
the control unit controls the spatial localization of the audio of the another user in a depth direction on a basis of a distance in the depth direction of an object in a field of view of each of the first user and the second user.

9 . The information processing device according to claim 1 , wherein
the control unit specifies an attention point of the another user and fixes a localization direction of the audio of the another user to the specified attention point.

10 . The information processing device according to claim 1 , further comprising:
an audio processing unit configured to perform processing of adjusting the audio of the another user.

11 . The information processing device according to claim 10 , wherein
the audio processing unit adjusts the audio of the another user on a basis of importance of the audio of the another user and an attribute of the audio.

12 . The information processing device according to claim 11 , wherein
the audio processing unit performs processing of dynamically adjusting at least one of a sound pressure, an equalizer (EQ), a reverb, or the spatial localization between the audios of the other users.

13 . The information processing device according to claim 12 , wherein
the audio processing unit adjusts the audio of each of the other users on a basis of a relationship between the other users.

14 . The information processing device according to claim 10 , wherein
the audio processing unit adjusts the spatial localization of a line-of-sight guidance sound for guiding a line-of-sight of the target user.

15 . The information processing device according to claim 10 , wherein
the audio processing unit adjusts spatial localization of a virtual stationary sound corresponding to the another user with respect to the target user.

16 . The information processing device according to claim 1 , wherein
the control unit controls the spatial localization of the audio of the another user in a depth direction on a basis of priorities of the first user and the second user.

17 . The information processing device according to claim 1 , wherein,
in a case where the target user is the first user and the another user is the second user, when there is a plurality of the second users, the control unit divides the second users into specific groups and divides the spatial localization of the audio for each of the specific groups.

18 . The information processing device according to claim 1 , wherein
the surrounding captured image is an omnidirectional image.

19 . An information processing method comprising:
by an information processing device, performing control of spatial localization of an audio of another user except a target user on a basis of information regarding at least one of a view direction of a first user corresponding to a captured image captured by an imaging device provided for the first user or a view direction of a second user who views a surrounding captured image in which surroundings of a position where the first user exists are captured as the captured image.

20 . A recording medium storing a program for causing a computer to function as a control unit configured to:
perform control of spatial localization of an audio of another user except a target user on a basis of information regarding at least one of a view direction of a first user corresponding to a captured image captured by an imaging device provided for the first user or a view direction of a second user who views a surrounding captured image in which surroundings of a position where the first user exists are captured as the captured image.

Assignees

• Sony Group Corp

Inventors

• Kimura Kentaro
• Shigeta Osamu
• Nishimura Yu
• Fuzawa Tsutomu
• Hasegawa Yuichi

Classifications

• H04S7/303 Primary

  Tracking of listener position or orientation · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N7/183 Primary

  for receiving images from a single remote source · CPC title

• H04S7/00

  Indicating arrangements; Control arrangements, e.g. balance control · CPC title