Methods and apparatus to generate an augmented environment including a weight indicator for a vehicle

Patent metadata

Field	Value
Publication number	US-10990822-B2
Application number	US-201816191134-A
Country	US
Kind code	B2
Filing date	Nov 14, 2018
Priority date	Oct 15, 2018
Publication date	Apr 27, 2021
Grant date	Apr 27, 2021

Abstract

Methods, apparatus, systems, and articles of manufacture are disclosed to generate an augmented environment including a weight indicator for a vehicle. An example disclosed apparatus includes a sensor interface to receive load data associated with a vehicle, and receive live video data from a camera, the live video data including a location of an object in the vehicle, a load mapper to generate a map of loads on the vehicle based on the load data, an object-to-weight correlator to correlate a load of the map of loads with the object, and an augmented reality generator to generate an augmented environment identifying the location of the object and the load correlated with the object.

First claim

What is claimed is:

1. An apparatus, comprising:
a sensor interface to:
receive load data associated with a vehicle; and
receive live video data from a camera, the live video data including a location of an object in the vehicle;

a load mapper to generate a map of loads on the vehicle based on the load data;
an object-to-weight correlator to correlate a load of the map of loads with the object; and
an augmented reality generator to generate an augmented environment identifying the location of the object and the load correlated with the object.

2. The apparatus of claim 1 , wherein the augmented environment is updated in real-time.

3. The apparatus of claim 2 , wherein the augmented environment is presented to a user via a mobile device, the mobile device including the camera.

4. The apparatus of claim 2 , wherein the augmented environment is presented to a user via a display integrated in the vehicle.

5. The apparatus of claim 1 , further including an object identifier to process the live video data to identify a visual anchor on the vehicle indicating a known location on the vehicle.

6. The apparatus of claim 1 further including:
a condition determiner to determine a load condition of the vehicle based on the load data; and
a guidance generator to modify the augmented environment with a visual indication based on the load condition, the visual indication including an instruction to move the object.

7. A method, comprising:
generating a map of loads on a vehicle based on load data associated with a sensor of the vehicle;
correlating a load of the map of loads with an object identified using live video data received from a camera; and
generating an augmented environment identifying a location of the object and the load correlated with the object.

8. The method of claim 7 , the method further including:
determining a load condition of the vehicle based on the load data; and
modifying the augmented environment with a visual indication based on the load condition, the visual indication including an instruction to move the object.

9. The method of claim 8 , wherein the visual indication is continuously updated as the objected is moved.

10. The method of claim 8 , wherein the visual indication is an arrow indicating a direction the object is to be moved.

11. The method of claim 7 further including presenting the augmented environment to a user via a display.

12. The method of claim 11 , wherein the display and the camera are included in a mobile device.

13. The method of claim 7 further including identifying a visual anchor indicating a known point on the vehicle.

14. A non-transitory computer readable medium comprising instructions, which when executed cause a processor to at least:
generate a map of loads on a vehicle based on load data associated with a sensor of the vehicle;
correlate a load of the map of loads with an object, the object identified from live video data received from a camera; and
generate an augmented environment identifying a location of the object and the load correlated with the object.

15. The non-transitory computer readable medium of claim 14 , further including instructions which when executed cause the processor to:
determine a load condition of the vehicle based on the load data; and
modify the augmented environment with a visual indication based on the load condition, the visual indication including an instruction to move the object.

16. The non-transitory computer readable medium of claim 15 , wherein the visual indication is continuously updated as the objected is moved.

17. The non-transitory computer readable medium of claim 15 , wherein the visual indication is an arrow indicating a direction the object is to be moved.

18. The non-transitory computer readable medium of claim 14 , further including instructions which when executed cause a processor to present the augmented environment to a user via a display.

19. The non-transitory computer readable medium of claim 18 , wherein the display and the camera are included in a mobile device.

20. The non-transitory computer readable medium of claim 14 , further including instructions which when executed cause the processor to identify a visual anchor indicating a known point on the vehicle.

21. The apparatus of claim 1 , wherein the camera is fixed to the vehicle.

22. The apparatus of claim 21 , wherein the object identifier compares the live video data to image data of the vehicle without objects to identify the object.

23. The method of claim 7 , further including identifying the object by comparing live video data to image data of the vehicle without objects.

24. The non-transitory computer readable medium of claim 14 , further including instructions which when executed cause the processor to compare the live video data to image data of the vehicle without objects.

Assignees

• Ford Global Tech Llc

Inventors

• Rogness Anton
• Lazarevski Peter Simeon
• Rajasingh Joshua
• Niedert Andrew
• Pearson Elliott

Classifications

• G01G19/02 Primary

  for weighing wheeled or rolling bodies, e.g. vehicles · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06F18/25

  Fusion techniques · CPC title

• B60W40/13

  Load or weight · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title