Smart device

Patent metadata

Field	Value
Publication number	US-10873837-B2
Application number	US-201916252543-A
Country	US
Kind code	B2
Filing date	Jan 18, 2019
Priority date	May 2, 2016
Publication date	Dec 22, 2020
Grant date	Dec 22, 2020

Abstract

An Internet of Thing (IoT) device includes a body with a processor, a camera and a wireless transceiver coupled to the processor.

First claim

What is claimed is:

1. A method for determining real-time vehicle operation cost for a driver during a trip, comprising:
mounting cameras on a vehicle to monitor traffic data, wherein at least one camera determines distances of neighboring objects from the camera;
generating a 3D model and determining obstacle information from nearby cars;
adjusting the 3D model based on the weather information and weather impact on sensors;
generating a comprehensive 3D model with traffic flow information;
collecting data from vehicle sensors monitoring vehicle operation and collecting vehicle driver behavior data including a driver emotional state, contextual information, driver history, and real-time driving information based on operation of the vehicle by the driver;
determining a real-time rate of operating the vehicle based on the adjusted 3D model traffic and vehicle speed, wherein each item of driver behavior data is weighted in determining the real-time rate or cost;
displaying the determined real-time rate to the driver.

2. The method of claim 1 , wherein the real-time rate comprises a real-time cost of vehicle use or loss of use.

3. The method of claim 1 , comprising displaying the real-time rate as a number or a color.

4. The method of claim 1 , comprising providing feedback to the driver in real-time or as a collective summary presented after a driving session is complete.

5. The method of claim 1 , comprising providing an on-board driver monitoring device in the vehicle to collect real-time data.

6. The method of claim 5 , wherein the monitoring device comprises a vehicles engine control unit/module (ECU/ECM), a transmission control unit (TCU), a power train control unit (PCU), on-board diagnostics (OBD), and one or more sensors and processors associated with a transmission system.

7. The method of claim 1 , comprising gathering data from the vehicle for a determination of how the vehicle is being driven in real-time.

8. The method of claim 1 , comprising gathering data identifying a route taken by the driver, a speed driven, a time of the trip, a weather condition during the trip, road traffic during the trip, and cell phone usage during the trip.

9. The method of claim 1 , comprising includes mounting cameras on left, right, front, back sides of the vehicle to monitor the traffic information.

10. The method of claim 1 , comprising detecting distances of nearby objects using one or more cameras.

11. The method of claim 1 , comprising capturing images of road views including potential collision events, proximity to neighboring car(s), frequency of brake usage, frequency of hard brakes.

12. The method of claim 1 , comprising using the camera for capturing driver behavior including of texting and use of phone while driving, speech of driver shouting or cursing at other drivers or other occupants, indications of intoxication, sleepiness, alcohol level, mood, aggressiveness.

13. The method of claim 1 , comprising detecting a driver emotional state.

14. The method of claim 1 , comprising detecting a driver emotional state with a camera and a microphone.

15. The method of claim 1 , comprising detecting a driver emotional state with a body sensor.

16. The method of claim 1 , comprising updating the real-time rate determination with data from insurance sites, insurance providers, driver insurance history.

17. The method of claim 1 , comprising updating the real-time rate determination based on a driver social media data feed or a search engine query with a driver name.

18. The method of claim 1 , comprising applying voice recognition to determine a user emotional state.

19. The method of claim 1 , comprising recommending a loss provider to underwrite a risk-of-loss policy based on the determined real-time operation of the vehicle including speed, driver behavior data, and traffic flow including speed.

20. A system, comprising:
a vehicle;
cameras coupled to the vehicle body on a plurality of locations including a left side, a right side, a front side, and a back side to capture a plurality of views and wherein at least one camera captures and determines distances of the neighboring objects from the camera and generates an integrated 3D model with obstacle information from nearby cars, wherein the 3D model is adjusted based on the weather information and weather impact on sensors;
sensors to detect driver emotion and driver behavior;
a processor coupled to the cameras and the sensors and to a wireless transceiver;
code to use the determined distances of the neighboring objects and the driver behavior to determine a risk of loss from driver behavior and 3D model, wherein each item of driver behavior data can have a different weight assigned weight in determining the real-time rate or cost.

Assignees

• Tran Bao
• Tran Ha

Inventors

• Tran Bao
• Tran Ha

Classifications

• H04N23/54

  Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils · CPC title

• A63B69/36 Primary

  for golf · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G06V40/23

  Recognition of whole body movements, e.g. for sport training · CPC title

• G06V20/20

  in augmented reality scenes · CPC title