Method and apparatus for remote vehicle screen operation

Patent metadata

Field	Value
Publication number	US-9755976-B2
Application number	US-201414565708-A
Country	US
Kind code	B2
Filing date	Dec 10, 2014
Priority date	Dec 10, 2014
Publication date	Sep 5, 2017
Grant date	Sep 5, 2017

Abstract

A method of remotely controlling a graphic display unit. Requesting, by a host system, assistance of a remote system relating to a respective application, host system including at least one host graphic display unit displaying operational graphics relating to a dedicated application of the host system. The at least one host graphic display unit of the host system is accessed by the remote system. Graphical application data relating to the respective application display is transmitted from the remote system to the host system. Instructional graphic information is projected on the at least one host graphics display unit. Remotely controlling, by the remote system, the at least one host vehicle graphic display unit by displaying to a user of the host system instructional information relating to the respective application. An adaptive session protocol controls a speed in which data is transmitted from the remote system to the host system.

First claim

What is claimed is:

1. A method of remotely controlling a graphic display unit comprising the steps of:
requesting, by a host system, assistance of a remote system relating to a respective application, the host system including at least one host graphic display unit displaying operational graphics relating to a dedicated application of the host system, the remote system including a remote graphical display unit, the remote system is in wireless communication with the host system;
accessing the at least one host graphic display unit of the host system by the remote system;
transmitting from the remote system to the host system graphical application data relating to the respective application display;
projecting instructional graphic information on the at least one host graphics display unit; and
remotely controlling, by the remote system, the at least one host graphic display unit by displaying to a user of the host system instructional information relating to the respective application;
wherein an adaptive session protocol controls a speed in which data is transmitted from the remote system to the host system, and
wherein the adaptive session protocol applies a framebuffer for controlling a sampling rate at which data is transmitted by the remote system to the host system.

2. The method of claim 1 , wherein the instructional graphic information projected on the host graphics display unit is projected as new content.

3. The method of claim 1 , wherein the instructional graphic information projected on the host graphics display unit is projected as an overlay to existing content.

4. The method of claim 1 , wherein the sampling rate of the framebuffer is dynamically adjusted according to packet indices at a transport layer of the host system.

5. The method of claim 4 , wherein the host system communicates a request to the remote system to transmit additional data in response to data in the framebuffer being consumed.

6. The method of claim 5 , wherein no data is transmitted in response to no status communication update between host system and the remote system.

7. The method of claim 4 , wherein the sampling rate of the framebuffer is increased in response to a difference between an index of a current outgoing packet in the host system transport layer and an index of a most recent acknowledgement of a packet in the host system transport layer being substantially constant for a predetermined period of time.

8. The method of claim 4 , wherein the dynamic adjustment of the sampling rate is determined by the following formula:
( P 0 −P 1 )< C 0 for K _ I _INTERVAL sec

where P 0 is the index of the current outgoing packet, and where P 1 is the index of the most recent acknowledged packet, C 0 is a maximum (P 0 −P 1 ) during a sample interval, and K_I_INTERVAL is a calibratable constant that specifies the interval required to increase the sampling rate.

9. The method of claim 8 , wherein the sampling rate is increased by a multiple of the previous sampling rate.

10. The method of claim 8 , wherein the sampling rate of the framebuffer is decreased in response to the difference between the index of a current outgoing packet in the host system transport layer and an index of a most recent acknowledgement of a packet in the host system transport layer increasing after a second predetermined period of time.

11. The method of claim 10 , wherein the dynamic adjustment for decreasing the sampling rate is determined by the following formula:
( P 0 −P 1 )< C 0 for K _ D _INTERVAL sec

where K_D_INTERVAL is a sample interval that is a calibratable constant that specifies the interval required to decrease the sampling rate.

12. The method of claim 11 , wherein the sampling rate is a fraction of the previous sampling rate.

13. The method of claim 11 , wherein the respective application which assistance is requested is an application different than the dedicated application primarily utilized on the host graphics display unit.

14. The method of claim 11 , further comprising the steps of:
requesting assistance of a remote system by a host system relating to the dedicated application displayed on the host graphic display unit;
accessing the at least one host graphic display unit of the host system by the remote system;
transmitting from the host system to the remote system graphical application data relating to the dedicated application displayed on a targeted host graphic display unit;
projecting the graphical application data on the remote graphic display unit;
remotely controlling, by the remote system, features of the dedicated application, the host graphic display unit displaying or overlaying instructional operations of the dedicated application as controlled by the remote system;
wherein the adaptive session protocol controls the sampling rate in which data related to the dedicated application displayed on the host system is transmitted from the host system to the remote system.

15. The method of claim 14 , wherein a host display client/server functions as a server, and a remote display client/server functions as a client when application data is transmitted from the host system to the remote system.

16. The method of claim 15 , wherein a host graphic codec solution provides an interface between the host graphic display unit host display client/server, the host graphic codec solution encoding application data prior to transmission to the remote system, and wherein the remote graphic codec solution provides an interface between the remote graphics display unit and the remote display client/server, the remote graphic codec solution decoding application data received from the host system.

17. The method of claim 11 , wherein a host display client/server functions as a client, and a remote client/server functions as a server when application data is transmitted from the remote vehicle to the host vehicle.

18. The method of claim 17 , wherein a remote graphic codec solution provides an interface between the remote graphics display unit and the remote display client/server, the remote graphic codec solution encoding application data prior to transmission to the host system, and wherein the host graphic codec solution provides an interface between the host graphics display unit and the host display client/server, the host graphic codec solution decoding application data received from the remote system.

19. The method of claim 1 , wherein application data is transmitted wirelessly between the host system and remote system.

20. The method of claim 1 , wherein wireless communication between the host system and remote system utilizes a long term evolution data pipe for data transmission.

21. The method of claim 1 , wherein the host system includes a mobile vehicle, and the remote system includes a fixed infrastructure.

Assignees

• Gm Global Tech Operations Llc

Inventors

• Bai Fan
• Shan Dan
• Grimm Donald K
• Osella Massimo

Classifications

• H04L69/24

  Negotiation of communication capabilities · CPC title

• H04L47/22 Primary

  Traffic shaping · CPC title

• H04L67/125 Primary

  involving control of end-device applications over a network · CPC title

• H04L67/14

  Session management (for real-time applications in data packet communications networks H04L65/1066) · CPC title

• H04L67/025

  for remote control or remote monitoring of applications · CPC title