Method and system for annotating graphs of vehicle data

Patent metadata

Field	Value
Publication number	US-11989980-B2
Application number	US-202217657965-A
Country	US
Kind code	B2
Filing date	Apr 5, 2022
Priority date	Oct 26, 2018
Publication date	May 21, 2024
Grant date	May 21, 2024

Abstract

An example method includes receiving, at a computing system, a first user input from a user interface during operation of a vehicle and responsive to receiving the first user input, determining a time of reception for the first user input. The method further includes receiving a first set of parameters from the vehicle that correspond to a first parameter identifier (PID). The method also includes determining a time of reception for each parameter, and based on the time of reception for the first user input and the time of reception for each parameter of the first set of parameters, determining a first temporal position for an indicator configured to represent the first user input on a graph of the parameters corresponding to the first PID. The method further includes displaying, on a display interface, the graph of the parameters corresponding to the first PID with the indicator in the first temporal position.

First claim

What is claimed is:

1. A method comprising:
obtaining, at a computing device, audio data received at a microphone while a vehicle traverses a route, wherein the microphone is communicatively coupled to the computing device and the computing device is located within or on the vehicle;
detecting, by the computing device, a vocal input in the audio data;
based on detecting the vocal input, generating audio information that assigns a time of reception of the vocal input by the microphone to the vocal input;
receiving, at the computing device and from the vehicle, parameters corresponding to a parameter identifier (PID) representing operation of a vehicle system while the vehicle traverses the route, wherein the computing device uses a data link connector (DLC) to receive the parameters corresponding to the PID representing operation of the vehicle system from an electronic control unit (ECU); and
displaying, by the computing device and on a display interface, a graph conveying the parameters corresponding to the PID representing the operation of the vehicle system while the vehicle traverses the route, wherein an indicator is positioned on the graph based the time of reception of the vocal input.

2. The method of claim 1 , further comprising:
detecting a selection of the indicator positioned on the graph; and
based on detecting the selection of the indicator, displaying the audio information on the display interface.

3. The method of claim 1 , further comprising:
based on detecting the vocal input, determining text that represents the vocal input using a speech recognition technique; and
wherein generating the audio information further comprises:
generating the audio information to further include the text that represents the vocal input.

4. The method of claim 3 , further comprising:
detecting a selection of the indicator positioned on the graph; and
based on detecting the selection of the indicator, displaying the text on the display interface.

5. The method of claim 4 , wherein displaying the text on the display interface comprises:
displaying the text in a popup box positioned proximate the graph, wherein the popup box includes the time of reception of the vocal input.

6. The method of claim 5 , further comprising:
displaying an option to edit the text that represents the vocal input.

7. The method of claim 1 , wherein detecting the vocal input in the audio data comprises:
detecting a first vocal input and a second vocal input in the audio data; and
wherein generating the audio information further comprises:
generating the audio information to assign (i) a first time of reception of the first vocal input by the microphone to the first vocal input and (ii) a second time of reception of the second vocal input by the microphone to the second vocal input; and
wherein displaying the graph conveying the parameters corresponding to the PID comprises:
displaying the graph with a first indicator and a second indicator positioned on the graph, wherein the first indicator represents the first vocal input and is positioned on the graph based on the first time of reception of the first vocal input, and wherein the second indicator represents the second vocal input and is positioned on the graph based on the second time of reception of the second vocal input.

8. The method of claim 1 , further comprising:
monitoring, using a global positioning system (GPS), respective locations for the vehicle while the vehicle traverses the route;
associating the audio data received at the microphone with respective locations for the vehicle; and
wherein generating the audio information further comprises:
generating the audio information to include a location of the vehicle.

9. The method of claim 1 , wherein displaying the graph conveying the parameters corresponding to the PID comprises:
displaying a vehicle data parameter (VDP) line graph that represents the parameters corresponding to the PID; and
positioning the indicator on the VDP line graph based on the time of reception of the vocal input.

10. The method of claim 1 , further comprising:
receiving an input from a sensor; and
wherein displaying the graph conveying the parameters corresponding to the PID representing the operation of the vehicle system comprises:
displaying a first indicator and a second indicator on the graph, wherein the first indicator corresponds to the indicator and represents the audio information, and wherein the second indicator represents the input from the sensor.

11. The method of claim 1 , further comprising:
based on capturing audio data received at the microphone, triggering a camera to capture one or more images.

12. The method of claim 11 , further comprising:
based on the audio data, determining a direction of a source of the audio data; and
wherein triggering the camera to capture one or more images comprises:
causing the camera to capture one or more images in the direction of the source of the audio data.

13. The method of claim 12 , wherein causing the camera to capture one or more images in the direction of the source of the audio data comprises:
causing the camera to capture one or more images of an interior of the vehicle.

14. The method of claim 1 , further comprising:
determining the time of reception for the vocal input based on when the microphone completed receiving the vocal input.

15. The method of claim 1 , further comprising:
determining the time of reception for the vocal input based on when the microphone initially started receiving the vocal input.

16. The method of claim 1 , further comprising:
coupling the computing device to the vehicle, wherein the computing device is configured to operate as a vehicle diagnostic tool.

17. A system comprising:
a display interface;
a microphone; and
a computing device configured to:
obtain audio data received at the microphone while a vehicle traverses a route, wherein the microphone is communicatively coupled to the computing device and the computing device is located within or on the vehicle;
detect a vocal input in the audio data;
based on detecting the vocal input, generate audio information that assigns a time of reception of the vocal input by the microphone to the vocal input;
receive, from the vehicle, parameters corresponding to a parameter identifier (PID) representing operation of a vehicle system while the vehicle traverses the route, wherein the computing device uses a data link connector (DLC) to receive the parameters corresponding to the PID representing operation of the vehicle system from an electronic control unit (ECU); and
display, on the display interface, a graph conveying the parameters corresponding to the PID representing the operation of the vehicle system while the vehicle traverses the route, wherein an indicator is positioned on the graph based the time of reception of the vocal input.

18. The system of claim 17 , wherein the computing device is further configured to:
based on detecting the vocal input, determine text that represents the vocal input using a speech recognition technique;
generate the audio information to include the text that represents the vocal input; and
based on detecting a selection of the indicator, causing the vocal input to play using an audio output.

19. The system of claim 17 , wherein the computing device is a smart phone.

20. A non-transitory computer readable medium having stored therein instructions executable by one or more processors to cause a computing syst

Assignees

• Snap On Incorporated

Inventors

• Covington Joshua C
• Merg Patrick S
• Foreman Jacob G

Classifications

• G07C5/002 Primary

  Analysing tachograph charts (arrangements for graph-reading in general G06K11/00) · CPC title

• G07C5/008

  communicating information to a remotely located station (transmission systems for measured values G08C) · CPC title

• G07C5/0825

  using optical means · CPC title

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G06Q10/20 Primary

  Administration of product repair or maintenance · CPC title