Virtual vehicle skin

Patent metadata

Field	Value
Publication number	US-10529104-B2
Application number	US-201715847337-A
Country	US
Kind code	B2
Filing date	Dec 19, 2017
Priority date	Dec 19, 2017
Publication date	Jan 7, 2020
Grant date	Jan 7, 2020

Abstract

A system and method of enabling an augmented reality/virtual reality (AR/VR) device to augment image or video data using a virtual vehicle skin, wherein the method is carried out by vehicle electronics included within a vehicle, the method including: establishing a connection to the AR/VR device using a wireless communications device included in the vehicle electronics of the vehicle; and sending a virtual vehicle skin response to the AR/VR device via the established connection, wherein the AR/VR device is configured to obtain background video and to display the virtual vehicle skin over the obtained background video so that the virtual vehicle skin overlays a portion of the vehicle, and wherein the virtual vehicle skin response includes the virtual vehicle skin or virtual vehicle skin access information that can be used by the AR/VR device to derive or obtain the virtual vehicle skin.

First claim

The invention claimed is:

1. A method of configuring an augmented reality/virtual reality (AR/VR) device to augment image or video data using a virtual vehicle skin, the method comprising:
capturing image or video data using a camera included on the AR/VR device;
receiving a virtual vehicle skin availability message from a vehicle, wherein the vehicle uses a wireless communications device to periodically broadcast the virtual vehicle skin availability message, and wherein the virtual vehicle skin availability message indicates that virtual vehicle skins are available for supplementing or augmenting a view of the vehicle;
in response to receiving the virtual vehicle skin availability message, sending a virtual vehicle skin request, wherein the virtual vehicle skin request is a request from the AR/VR device to obtain the virtual vehicle skin; and
receiving a virtual vehicle skin response, wherein the virtual vehicle skin response includes a digital representation of the virtual vehicle skin or information that can be used by the AR/VR device to obtain the digital representation of the virtual vehicle skin, and wherein the virtual vehicle skin is associated with the vehicle as a result of a virtual vehicle skin association request that is received from a user and that indicates that the user desires to have the virtual vehicle skin associated with the vehicle.

2. The method of claim 1 , wherein the virtual vehicle skin request is sent to the vehicle, and wherein the virtual vehicle skin response is sent by the vehicle.

3. The method of claim 2 , wherein the virtual vehicle skin response includes virtual vehicle skin access information, and wherein the method further comprises the steps of:
sending a second virtual vehicle skin request to a remote server using the virtual vehicle skin access information; and
receiving a second virtual vehicle skin response that includes the digital representation of the virtual vehicle skin.

4. The method of claim 1 , wherein the virtual vehicle skin includes a plurality of virtual vehicle skin components, and wherein the method further comprises the steps of:
determining to display at least one virtual vehicle skin component of the plurality of virtual vehicle skin components based on the image or video data; and
rendering at least part of the at least one virtual vehicle skin component on a display of the AR/VR device.

5. The method of claim 4 , further comprising the step of, before rendering the at least part of the at least one virtual vehicle skin component on the display of the AR/VR device, modifying the at least one virtual vehicle skin component based on the captured image or video data.

6. The method of claim 1 , wherein the virtual vehicle skin includes virtual exterior environment graphics, and wherein the method further comprises the steps of:
determining exterior areas that are exterior to the vehicle and within the captured image or video data; and
rendering the virtual exterior environment graphics within the exterior areas.

7. The method of claim 1 , further comprising the step of determining an orientation of the AR/VR device using an accelerometer included on the AR/VR device.

8. The method of claim 1 , wherein the vehicle is configured to determine a position of the AR/VR device within the vehicle and, thereafter, to obtain the virtual vehicle skin based on the position of the AR/VR device.

Assignees

• Gm Global Tech Operations Llc

Inventors

• Kamini Aditya S
• Elswick Richard
• Williams Nathaniel H

Classifications

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• H04L67/12

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title

• B60R2300/20

  characterised by the type of display used · CPC title

• B60K35/00

  Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles · CPC title

• B60R1/00

  Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles · CPC title