Information processing device, information processing method, and program

Patent metadata

Field	Value
Publication number	US-12026430-B2
Application number	US-202017442018-A
Country	US
Kind code	B2
Filing date	Mar 16, 2020
Priority date	Mar 29, 2019
Publication date	Jul 2, 2024
Grant date	Jul 2, 2024

Abstract

Provided is an information processing device and an information processing method, the information processing device including a control unit that, on the basis of a position of a recognized operation object, dynamically controls output of an information associated with at least one operation region in which the recognized operation object is located, the control unit being configured to, in a case where the recognized operation object is located in the operation region, control execution of a device function corresponding to the operation region in which the recognized operation object is located, and the operation region including a region incapable of being visually recognized by a user.

First claim

The invention claimed is:

1. An information processing device comprising:
a control unit configured to, on a basis of a position of a recognized operation object, dynamically control output of information associated with at least one operation region in which the recognized operation object is located,
wherein, in a case where the recognized operation object is located in the operation region, the control unit is further configured to control execution of a device function corresponding to the operation region in which the recognized operation object is located,
the operation region includes a region incapable of being visually recognized by a user,
the control unit is further configured to dynamically control output of a first predetermined sound associated with a first operation region of the at least one operation region in which the recognized operation object is located on a basis of a first position of the recognized operation object and a second predetermined sound associated with a second operation region of the at least one operation region in which the recognized operation object is located on a basis of a second position of the recognized operation object, the second operation region being different than the first operation region, the second predetermined sound being different than the first predetermined sound, and the second recognized operation being different than the first recognized operation, and
the control unit is implemented via at least one processor.

2. The information processing device according to claim 1 ,
wherein, further on a basis of whether or not the position of the recognized operation object is in the operation region, the control unit is further configured to dynamically control the output of sound.

3. The information processing device according to claim 2 ,
wherein the control unit is further configured to dynamically control the output of the sound in such a way as to guide the operation object to the operation region.

4. The information processing device according to claim 1 ,
wherein, on a basis of the position of the recognized operation object relative to a reference region serving as a reference for an operation by the operation object, the control unit is further configured to dynamically control the output of sound.

5. The information processing device according to claim 2 ,
wherein the control unit is further configured to dynamically control the output of the sound in such a way as to guide the recognized operation object to the reference region.

6. The information processing device according to claim 2 ,
wherein, in a case where the position of the recognized operation object is in the reference region, the control unit is further configured to dynamically control the output of the sound in such a way as to notify that the position of the recognized operation object is in the reference region.

7. The information processing device according to claim 2 ,
wherein the control unit is further configured to determine, as the reference region, the position of the recognized operation object at a time when the operation by the operation object is first started.

8. The information processing device according to claim 1 ,
wherein, in a case where a plurality of the operation regions exists, the control unit is further configured to dynamically control output of a different sound corresponding to each operation region of the plurality of operation regions.

9. The information processing device according to claim 8 ,
wherein, in a case where the recognized operation object is moving, further on a basis of a movement direction of the recognized operation object, the control unit is further configured to dynamically control the output of the different sound corresponding to each operation region of the plurality of operation regions.

10. The information processing device according to claim 1 ,
wherein, further on a basis of a position relation between the position of the recognized operation object and a position of each of the operation regions, the control unit is further configured to dynamically control output of a sound corresponding to each of the operation regions.

11. The information processing device according to claim 10 ,
wherein the position relation with each of the operation regions is a distance to each of the operation regions, and on a basis of the distance from the recognized operation object to each of the operation regions, the control unit is further configured to dynamically control the output of the sound corresponding to each of the operation regions.

12. The information processing device according to claim 1 ,
wherein, in a case where a movement of the recognized operation object from an inside of the operation region to an outside of the operation region is predicted, the control unit is further configured to dynamically control the output of sound in such a way as to notify of the predicted movement of the recognized operation object.

13. The information processing device according to claim 1 ,
wherein, further on a basis of an in-space position relation between the recognized operation object and the information processing device, the control unit is further configured to dynamically control the output of sound.

14. An information processing method comprising:
dynamically controlling, on a basis of a position of a recognized operation object, output of information associated with at least one operation region in which the recognized operation object is located;
controlling, in a case where the recognized operation object is located in the operation region, execution of a device function corresponding to the operation region in which the recognized operation object is located,
wherein the operation region includes a region incapable of being visually recognized by a user; and
dynamically controlling output of a first predetermined sound associated with a first operation region of the at least one operation region in which the recognized operation object is located on a basis of a first position of the recognized operation object and a second predetermined sound associated with a second operation region of the at least one operation region in which the recognized operation object is located on a basis of a second position of the recognized operation object, the second operation region being different than the first operation region, the second predetermined sound being different than the first predetermined sound, and the second recognized operation being different than the first recognized operation.

15. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute an information processing method, the method comprising:
dynamically controlling, on a basis of a position of a recognized operation object, controls output of information associated with at least one operation region in which the recognized operation object is located;
controlling, in a case where the recognized operation object is located in the operation region, execution of a device function corresponding to the operation region in which the recognized operation object is located,
wherein the operation region includes a region incapable of being visually recognized by a user; and
dynamically controlling output of a first predetermined sound associated with a first operation region of the at least one operation region in which the recognized operation object is located on a basis of a first position of the recognized operation object and a second predetermined sound associated with a se

Assignees

• Sony Group Corp

Inventors

• Shimizu Junichi
• Takahashi Kei
• Nagahara Junichi
• Fujiki Manabu
• Imura Tomohiro
• Kitahara Keiichi

Classifications

• H04R2430/01

  Aspects of volume control, not necessarily automatic, in sound systems · CPC title

• H04R1/1041

  Mechanical or electronic switches, or control elements (switches in general H01H) · CPC title

• G06F3/03547

  Touch pads, in which fingers can move on a surface · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/165 Primary

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title