Information processing system

Patent metadata

Field	Value
Publication number	US-12508908-B2
Application number	US-202318244384-A
Country	US
Kind code	B2
Filing date	Sep 11, 2023
Priority date	Sep 12, 2022
Publication date	Dec 30, 2025
Grant date	Dec 30, 2025

Abstract

An information processing system includes a first device that is mounted in a mobile object which an occupant boards and a second device that is used by a user at a place different from the mobile object. The first device includes a first communication device configured to communicate with a second communication device of the second device and a camera unit including one or more cameras. The second device includes the second communication device configured to communicate with the first communication device, a detection device configured to detect an orientation direction of the user, and a display device configured to display an image corresponding to the orientation direction when seen from the predetermined seat out of images captured by the camera unit. The second device identifies a sight area to which a sightline of the user is directed in the image, and the first device displays the sight area received via the first communication device in a predetermined mode on a display device.

First claim

What is claimed is:

1 . An information processing system comprising:
a first device that is mounted in a mobile object which an occupant boards; and a second device that is used by a user at a place different from the mobile object, wherein the first device includes: a first communication device configured to communicate with a second communication device of the second device; and a camera unit including one or more cameras including at least an inside camera that is provided on a predetermined seat of the mobile object and images the inside of the mobile object when seen from the predetermined seat, wherein the second device includes: the second communication device configured to communicate with the first communication device; a detection device configured to detect an orientation direction of the user; and a display device configured to display an image corresponding to the orientation direction when seen from the predetermined seat out of images captured by the camera unit, wherein the second device identifies a sight area to which a sightline of the user is directed in the image, wherein the second communication device transmits the identified sight area to the first communication device, wherein the first device displays the sight area received via the first communication device in a predetermined mode on a display device, wherein the display device of the first device includes a plurality of indicators, and wherein the first device turns on at least one of the plurality of indicators corresponding to a direction of the sight area in the image as the predetermined mode.

2 . The information processing system according to claim 1 , wherein the display device of the first device includes a display, and
wherein the first device displays the sight area on the display as the predetermined mode.

3 . The information processing system according to claim 1 , wherein the display device of the first device includes a plurality of indicators and a display, and
wherein the first device switches the predetermined mode between a mode in which at least one of the plurality of indicators corresponding to a direction of the sight area in the image is turned on and a mode in which the sight area is displayed on the display according to the occupant's operation.

4 . The information processing system according to claim 1 , wherein the display device of the first device includes a plurality of indicators and a display, and
wherein the first device switches the predetermined mode between a mode in which at least one of the plurality of indicators corresponding to a direction of the sight area in the image is turned on and a mode in which the sight area is displayed on the display on the basis of a predetermined condition.

5 . The information processing system according to claim 4 , wherein the predetermined condition is that an object is present within a predetermined distance from the mobile object, and
wherein the first device sets the predetermined mode to the mode in which the sight area is displayed on the display when the predetermined condition has been satisfied.

6 . The information processing system according to claim 1 , wherein the second communication device transmits information of the orientation direction to the first communication device,
wherein the first device further includes a first control device configured to control the first communication device such that an image corresponding to the orientation direction acquired via the first communication device out of images captured by the camera unit is selectively transmitted to the second communication device, and wherein the display device of the second device displays an image corresponding to the orientation direction when seen from the predetermined seat and acquired via the second communication device.

7 . The information processing system according to claim 1 , wherein the first communication device transmits images captured by the camera unit to the second communication device, and
wherein the second device further includes a second control device configured to selectively display an image corresponding to the orientation direction out of the images captured by the camera unit on the display device.

8 . The information processing system according to claim 1 , wherein the display device is a display device of a virtual reality (VR) goggle, and
wherein the detection device includes a physical sensor attached to the VR goggle.

9 . The information processing system according to claim 1 , wherein the mobile object is a vehicle, and
wherein the predetermined seat is a passenger's seat.

Assignees

• Honda Motor Co Ltd

Inventors

• Ishida Yusuke
• Onaka Junichiro
• Maruyama Kenta

Classifications

• B60K2360/176

  Camera images · CPC title

• B60K2360/149

  Instrument input by detecting viewing direction not otherwise provided for · CPC title

• B60K2360/21

  using cameras · CPC title

• B60K35/28

  characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver · CPC title

• B60K35/23

  Head-up displays [HUD] (optical aspects of head-up displays G02B27/01) · CPC title