Method and system for annotating graphs of vehicle data

Patent metadata

Field	Value
Publication number	US-11688206-B2
Application number	US-202117152130-A
Country	US
Kind code	B2
Filing date	Jan 19, 2021
Priority date	Oct 26, 2018
Publication date	Jun 27, 2023
Grant date	Jun 27, 2023

Abstract

An example method includes receiving, at a computing system, a first user input from a user interface during operation of a vehicle and responsive to receiving the first user input, determining a time of reception for the first user input. The method further includes receiving a first set of parameters from the vehicle that correspond to a first parameter identifier (PID). The method also includes determining a time of reception for each parameter, and based on the time of reception for the first user input and the time of reception for each parameter of the first set of parameters, determining a temporal position for an indicator configured to represent the first user input on a graph of the parameters corresponding to the first PID. The method further includes displaying, on a display interface, the graph of the parameters corresponding to the first PID with the indicator in the determined temporal position.

First claim

What is claimed is:

1. A method comprising:
obtaining, at a computing device having a camera and a microphone, image data and corresponding audio data during navigation by a vehicle, wherein the computing device is located in or on the vehicle;
obtaining, at the computing device, speed and position information during navigation by the vehicle;
based on the speed and position information, determining, by the computing device, a map representative of a route traveled by the vehicle; and
generating, by the computing device, a graphical user interface showing the map representative of the route traveled by the vehicle with at least one icon positioned along the route, wherein the at least one icon corresponds to the image data and corresponding audio data, wherein a position of the at least one icon along the route depends on a location of the vehicle when the computing device obtained the image data and corresponding audio data, and wherein selection of the at least one icon causes the graphical user interface to convey the image data and corresponding audio data.

2. The method of claim 1 , wherein the computing device is a mobile computing device, and
wherein obtaining image data and corresponding audio data during navigation by the vehicle comprises:
capturing video using the camera and corresponding audio using the microphone.

3. The method of claim 2 , wherein capturing video using the camera and corresponding audio using the microphone comprises:
receiving a vocal input via the microphone; and
based on receiving the vocal input, determining text that represents the vocal input using speech recognition.

4. The method of claim 3 , further comprising:
receiving a selection of the at least one icon; and
based on receiving the selection of the at least one icon, causing the graphical user interface to display the text that represents the vocal input.

5. The method of claim 4 , wherein causing the graphical user interface to display the text that represents the vocal input comprises:
displaying the text in a popup box.

6. The method of claim 4 , wherein causing the graphical user interface to display the text that represents the vocal input further comprises:
providing an option that enables editing the text that represents the vocal input;
receiving one or more edits to the text that represents the vocal input; and
based on receiving the one or more edits to the text, displaying edited text.

7. The method of claim 1 , wherein obtaining speed and position information during navigation by the vehicle comprises:
determining speed and position information using GPS measurements via a GPS receiver of the computing device.

8. The method of claim 1 , wherein determining the map representative of the route traveled by the vehicle comprises:
determining the map with indications of speeds traveled by the vehicle during respective portions of the route.

9. The method of claim 1 , further comprising:
storing data corresponding to the graphical user interface in memory, wherein the memory is accessible by a plurality of computing devices.

10. The method of claim 1 , further comprising:
obtaining information corresponding to the vehicle, wherein the information indicates a make and a model of the vehicle; and
wherein generating the graphical user interface further comprises:
generating the graphical user interface to further display the make and the model of the vehicle.

11. The method of claim 1 , further comprising:
obtaining an indication of weather during navigation by the vehicle; and
wherein generating the graphical user interface further comprises:
generating the graphical user interface to further display the indication of weather obtained during navigation by the vehicle.

12. The method of claim 1 , further comprising:
receiving, at the computing device, a set of parameter identifiers (PIDs) from the vehicle during navigation by the vehicle, wherein each PID represents one or more measurements by a vehicle sensor; and
wherein generating the graphical user interface further comprises:
generating the graphical user interface such that the graphical user interface represents at least one PID from the set of PIDs.

13. The method of claim 12 , wherein generating the graphical user interface such that the graphical user interface represents at least one PID from the set of PIDs comprises:
generating the graphical user interface with a graph representing one or more PIDs.

14. The method of claim 13 , wherein generating the graphical user interface with the graph representing one or more PIDs comprises:
generating the graphical user interface with a first graph corresponding to a first PID, wherein the first graph includes at least one indicator corresponding to a second PID, and wherein selection of the at least one indicator causes the graphical user interface to display one or more options associated with the second PID.

15. The method of claim 1 , further comprising:
causing the graphical user interface to further display a graph view slider,
wherein a length of the graph view slider represents the route traveled by the vehicle, and
wherein adjusting a position of a selector on the graph view slider causes the graphical user interface to display information obtained by the computing device when the vehicle was at a location along the route corresponding to the position of the selector on the graph view slider.

16. The method of claim 1 , further comprising:
detecting a first triggering event at a first sensor; and
based on detecting the first triggering event, causing the graphical user interface to include a first representation indicative of one or more measurements from the first sensor.

17. The method of claim 16 , wherein detecting the first triggering event at the first sensor comprises:
detecting a particular measurement from the first sensor exceeding a threshold; and
wherein causing the graphical user interface to include the first representation indicative of one or more measurements from the first sensor comprises:
causing the graphical user interface to display the first representation based on the one or more measurements from the first sensor corresponding to a first parameter identifier (PID).

18. The method of claim 17 , further comprising:
detecting a second triggering event at a second sensor; and
based on detecting the second triggering event, causing the graphical user interface to switch from the first representation to a second representation, wherein the second representation is indicative of one or more measurements from the second sensor.

19. A system comprising:
a computing device having a camera and a microphone, wherein the computing device is configured to:
obtain image data and corresponding audio data during navigation by a vehicle,

wherein the computing device is located in the vehicle;
obtain speed and position information during navigation by the vehicle;
based on the speed and position information, determine a map representative of a route traveled by the vehicle; and
generate a graphical user interface showing the map representative of the route traveled by the vehicle with at least one icon positioned along the route, wherein the at least one icon corresponds to the image data and corresponding audio data, wherein a position of the at least one icon along the route depends on a location of the vehicle when the computing device obtained the image data and corresponding audio data, and wherein selection of the at least one icon causes the

Assignees

• Snap On Incorporated

Inventors

• Covington Joshua C
• Merg Patrick S
• Foreman Jacob G

Classifications

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G07C5/0825

  using optical means · CPC title

• G07C5/002 Primary

  Analysing tachograph charts (arrangements for graph-reading in general G06K11/00) · CPC title

• G07C5/008

  communicating information to a remotely located station (transmission systems for measured values G08C) · CPC title

• G06Q50/40

  Business processes related to the transportation industry (shipping G06Q10/083) · CPC title