Vehicle control system and vehicle control method

Patent metadata

Field	Value
Publication number	US-11475690-B2
Application number	US-202016804042-A
Country	US
Kind code	B2
Filing date	Feb 28, 2020
Priority date	Mar 7, 2019
Publication date	Oct 18, 2022
Grant date	Oct 18, 2022

Abstract

A vehicle control system includes a recognizer configured to recognize first content displayed on a terminal device, and an identifier configured to identify a person carrying the terminal device with the first content displayed thereon outside the vehicle as a user scheduled to use the vehicle or a person relevant to the user on the basis of a comparison between the first content recognized by the recognizer and one or more pieces of content associated with the vehicle.

First claim

What is claimed is:

1. A vehicle control system comprising:
a processor configured to execute instructions to:
recognize a person outside a vehicle using sensors including a camera,
recognize first content displayed on a screen of a terminal device by analyzing an image captured by the camera, which is the image of the screen of the terminal device carried by the person;
compare the recognized first content and predetermined content associated with the vehicle, and
identify the person as a user scheduled to use the vehicle or a person relevant to the user based on a comparison between the recognized first content and the predetermined content,
wherein the processor configured to further execute instructions to:
when it is recognized that there are a plurality of persons outside the vehicle, and when it is the recognized that the first content is displayed on the screen of the terminal device carried by each of the plurality of persons, transmit second content different from the first content the terminal device carried by the user or the person relevant to the user, and
when it is the recognized that second content is displayed on the screen of the terminal device carried by a person among the terminal device each of the plurality of persons, identify the person carrying the terminal device with the second content displayed thereon as the user or the person relevant to the user.

2. The vehicle control system according to claim 1 , wherein the predetermined content is content for identifying the person as the user or the person relevant to the user and having features for comparison with features that the first content has, and
wherein the processor configured to further execute instructions to: identify the person as the user or the person relevant to the user when the features of the first content is the same as the features of the predetermined content.

3. The vehicle control system according to claim 1 , wherein the processor configured to further execute instructions to:
control steering and a speed of the vehicle so that the vehicle is stopped on the side of the user or the person relevant to the user when it is identified that that the person is the user or the person relevant to the user.

4. The vehicle control system according to claim 1 ,
wherein a first image with an arrangement of one or more colors is included in the first content,
a second image with an arrangement of one or more colors is included in the predetermined content, and
wherein the processor configured to further execute instructions to: identify the person as the user or the person relevant to the user when the color arrangement of the first image is the same as the color arrangement of the second image.

5. The vehicle control system according to claim 1 ,
wherein a first image in which a first pattern has been drawn is included in the first content,
a second image in which a second pattern has been drawn is included in the predetermined content, and
wherein the processor configured to further execute instructions to: identify the person as the user or the person relevant to the user when the first pattern is the same as the second pattern.

6. The vehicle control system according to claim 1 , wherein the processor configured to further execute instructions to: brighten the screen of the terminal device, as compared with a case in which a content is not display on the screen of the terminal device when the content display on the screen of the terminal device.

7. The vehicle control system according to claim 1 ,
wherein first sub-content associated with a control aspect of the vehicle is included in the first content,
second sub-content associated with the control aspect of the vehicle is included in the predetermined content, and
wherein the processor configured to further execute instructions to: control the vehicle based on the control aspect associated with the first sub-content or the second sub-content when the first sub-content is the same as the second sub-content.

8. A vehicle control method comprising:
recognizing a person outside a vehicle using sensors including a camera,
recognizing first content displayed on a screen of a terminal device by analyzing an image captured by the camera, which is the image of the screen of the terminal device carried by the person;
comparing the recognized first content and predetermined content associated with the vehicle,
identifying the person as a user scheduled to use the vehicle or a person relevant to the user based on a comparison between the recognized first content and the predetermined content,
when it is recognized that there are a plurality of persons outside the vehicle, and when it is the recognized that the first content is displayed on the screen of the terminal device carried by each of the plurality of persons, transmitting second content different from the first content the terminal device carried by the user or the person relevant to the user, and
when it is the recognized that second content is displayed on the screen of the terminal device carried by a person among the terminal device each of the plurality of persons, identifying the person carrying the terminal device with the second content displayed thereon as the user or the person relevant to the user.

Assignees

• Honda Motor Co Ltd

Inventors

• Yamanaka Hiroshi
• Yamane Katsuyasu
• Mimura Yoshitaka
• Sugihara Chie
• Motegi Yuki
• Shibauchi Tsubasa

Classifications

• G06V20/56

  exterior to a vehicle by using sensors mounted on the vehicle · CPC title

• G06V40/103 Primary

  Static body considered as a whole, e.g. static pedestrian or occupant recognition · CPC title

• G06Q10/06311 Primary

  Scheduling, planning or task assignment for a person or group · CPC title

• B60W2556/45

  External transmission of data to or from the vehicle · CPC title

• B60W2720/10

  Longitudinal speed · CPC title