Overlaying ads on camera feed in automotive viewing applications

Patent metadata

Field	Value
Publication number	US-10694262-B1
Application number	US-201916299394-A
Country	US
Kind code	B1
Filing date	Mar 12, 2019
Priority date	Mar 12, 2019
Publication date	Jun 23, 2020
Grant date	Jun 23, 2020

Abstract

An apparatus includes a capture device and a processor. The capture device may be configured to generate video frames of an environment near a vehicle. The processor may be configured to receive video frames from the capture device, perform video operations to detect objects in the video frames, determine advertisement locations in the video frames based on the objects detected in the video frames, insert advertisements at the advertisement locations and generate video data for a display. The video data may comprise the video frames with the inserted advertisements.

First claim

The invention claimed is:

1. An apparatus comprising:
a capture device connected to a vehicle and configured to generate a plurality of video frames of an environment near an outside of said vehicle; and
a processor configured to (i) receive video frames from said capture device, (ii) perform video operations to detect objects in said video frames, (iii) determine one or more advertisement locations in said video frames based on said objects detected in said video frames, (iv) insert an advertisement at said advertisement locations and (v) generate video data for a display mounted in said vehicle, wherein said video data comprises said video frames with said inserted advertisement.

2. The apparatus according to claim 1 , wherein said advertisement locations are determined by distinguishing appropriate sections of said video frames from inappropriate sections of said video frames.

3. The apparatus according to claim 2 , wherein said appropriate sections comprise non-drivable surface in said objects in said video frames.

4. The apparatus according to claim 2 , wherein said inappropriate sections comprise traffic signs, drivable surfaces and obstacles.

5. The apparatus according to claim 1 , wherein said inserted advertisement is reformatted and overlaid on top of said advertisement locations.

6. The apparatus according to claim 1 , wherein said inserted advertisement comprises a virtual pop up at said advertisement locations.

7. The apparatus according to claim 1 , wherein said inserted advertisement is selected based on a context.

8. The apparatus according to claim 7 , wherein said apparatus is further configured to determine said context based on at least one of a location, a time of day, said detected objects, driver behavior or route information.

9. The apparatus according to claim 1 , further configured to connect to a cloud service, wherein (i) said processor selects said inserted advertisement from a plurality of advertisements and (ii) said cloud service provides updates for said plurality of advertisements.

10. The apparatus according to claim 9 , wherein said apparatus is configured to connect to said cloud service using a LTE connection.

11. The apparatus according to claim 1 , wherein said display comprises at least one of an electronic mirror, a surround view monitor, an infotainment system, or a back-up camera display.

12. The apparatus according to claim 1 , wherein said capture device is one of a plurality of capture devices.

13. The apparatus according to claim 1 , wherein said capture device comprises at least one of an infrared camera, a depth measuring camera or a Bayer color camera.

14. The apparatus according to claim 1 , wherein the processor is further configured to determine when to insert said advertisement in response to detected driving conditions.

15. The apparatus according to claim 14 , wherein said driving conditions comprise a level of autonomous driving.

16. The apparatus according to claim 14 , wherein (i) said processor is further configured to implement sensor fusion and (ii) said sensor fusion is configured to combine information from said video operations with information received from a plurality of sensors of said vehicle to make inferences about said driving conditions.

17. The apparatus according to claim 1 , wherein said apparatus is configured to overlay said advertisement on a camera feed in and automotive viewing application.

18. The apparatus according to claim 2 , wherein said appropriate sections comprise a roadside advertisement in said objects in said video frames.

Assignees

• Ambarella Int Lp

Inventors

• Hedman Greg
• Pertsel Shimon

Classifications

• H04N21/812 Primary

  involving advertisement data (advertising per se G06Q30/02) · CPC title

• H04N21/44008

  involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• H04N21/4223

  Cameras (H04N23/00 takes precedence) · CPC title

• H04N21/41422

  located in transportation means, e.g. personal vehicle (arrangements specially adapted for transportation systems in broadcast systems H04H20/62) · CPC title

• H04N21/2668

  Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)} · CPC title