System and method for communicating non-standard video data via USB

Patent metadata

Field	Value
Publication number	US-11064247-B1
Application number	US-202016887233-A
Country	US
Kind code	B1
Filing date	May 29, 2020
Priority date	May 29, 2020
Publication date	Jul 13, 2021
Grant date	Jul 13, 2021

Abstract

Some embodiments include an apparatus, method, and computer program product for receiving non-standard video data via a single standard universal serial bus (USB) interface, where the non-standard video data includes sensor data from one or more sensors in addition to standard video frames from an image detector. Some embodiments include recovering a standard video picture encoding packet from a standard USB packet, and recovering non-standard video data. Some embodiments include detecting a pseudo-video frame within the non-standard video data, determining sensor data from one or more sensors from the pseudo-video frame, and transmitting the sensor data to a monitor scaler processor. Some embodiments include storing the standard USB packet, and in response to the detecting, discarding the pseudo-video frame.

First claim

What is claimed is:

1. An apparatus for transmitting non-standard video data, comprising:
a transceiver; and
one or more processors coupled to the transceiver, configured to:
receive standard video frames;
determine that sensor data from one or more sensors have been received;
in response to the determination, determine a pseudo-video frame that corresponds to the sensor data;
generate the non-standard video data corresponding to the pseudo-video frame and the standard the video frames;
encode the non-standard video data to a standard video picture encoding packet;
encode the standard video picture encoding packet to a standard universal service bus (USB) packet; and
transmit the standard USB packet via a single standard USB interface.

2. The apparatus of claim 1 , wherein the one or more sensors comprise: an ambient light sensor, a proximity sensor, a motion sensor, a microphone, or a people counter sensor.

3. The apparatus of claim 1 , wherein to generate the non-standard video data, the one or more processors are configured to:
add the pseudo-video frame to the standard video frames; or
replace a video frame of the standard video frames with the pseudo-video frame.

4. The apparatus of claim 1 , wherein to determine the pseudo-video frame, the one or more processors are configured to: encode the sensor data to: a pattern on a video frame, a color on a video frame, an audio portion of a video frame, or a watermark added to a video frame.

5. The apparatus of claim 1 , wherein the standard video picture encoding packet is based on: MPEG-4 Part 2 protocol, YUY2 protocol, or H.264 protocol.

6. The apparatus of claim 5 , wherein the standard video picture encoding packet is an MPEG-4 Part 2 packet, and to encode the non-standard video data to the MPEG-4 Part 2 packet, the one or more processors are configured to: include the non-standard video data in a data field of the MPEG-4 Part 2 packet.

7. The apparatus of claim 6 , wherein to include the non-standard video data in the data field of the MPEG-4 Part 2 packet, the one or more processors are configured to:
create a quasi header field comprising the pseudo-video frame; and
create a quasi data field comprising the standard video frames, wherein the quasi header field and the quasi data field are carried within the data field of the MPEG-4 Part 2 packet.

8. An apparatus for receiving non-standard video data, comprising:
a transceiver; and
one or more processors coupled to the transceiver, configured to:
receive a standard universal serial bus (USB) packet via a single standard USB interface;
recover a standard video picture encoding packet from the standard USB packet;
recover the non-standard video data from the standard video picture encoding packet;
detect a pseudo-video frame within the non-standard video data;
determine, from the pseudo-video frame, sensor data from one or more sensors; and
transmit the sensor data to a monitor scaler processor.

9. The apparatus of claim 8 , further comprising:
a gated buffer coupled to the one or more processors, wherein the gated buffer is configured to store the standard USB packet, wherein the one or more processors are further configured to: in response to the detection, transmit a discard flag to the gated buffer.

10. The apparatus of claim 8 , wherein the sensor data comprises: ambient light sensor data, proximity sensor data, motion sensor data, audio data, or people counter sensor data.

11. The apparatus of claim 8 , wherein to determine from the pseudo-video frame, the sensor data from the one or more sensors, the one or more processors are configured to: decode the sensor data from: a pattern of the pseudo-video frame, a color of the pseudo-video frame, an audio portion of the pseudo-video frame, or a watermark added to the pseudo-video frame.

12. The apparatus of claim 8 , wherein the standard video picture encoding packet is based on: MPEG-4 Part 2 protocol, YUY2 protocol, or H.264 protocol.

13. The apparatus of claim 12 , wherein the standard video picture encoding packet is an MPEG-4 Part 2 packet, and to recover the non-standard video data from the MPEG-4 Part 2 packet, the one or more processors are configured to: decode the non-standard video data from a data field of the MPEG-4 Part 2 packet.

14. The apparatus of claim 13 , wherein to decode the non-standard video data from the data field of the MPEG-4 Part 2 packet, the one or more processors are configured to:
decode a quasi header field comprising the pseudo-video frame; and
decode a quasi data field comprising video frames, wherein the quasi header field and the quasi data field are within the data field of the MPEG-4 Part 2 packet.

15. A non-transitory computer-readable medium storing instructions that, when executed by a processor of a first electronic device, cause the processor to perform operations for receiving non-standard video data, the operations comprising:
receiving a standard universal serial bus (USB) packet via a single standard USB interface;
recovering a standard video picture encoding packet from the standard USB packet;
recovering the non-standard video data from the standard video picture encoding packet;
detecting a pseudo-video frame within the non-standard video data;
determining, from the pseudo-video frame, sensor data from one or more sensors; and
transmitting the sensor data to a monitor scaler processor.

16. The non-transitory computer-readable medium of claim 15 , wherein the operations further comprise:
storing the standard USB packet at a gated buffer;
in response to the detecting, discard the pseudo-video frame.

17. The non-transitory computer-readable medium of claim 15 , wherein the sensor data comprises: ambient light sensor data, proximity sensor data, motion sensor data, audio data, or people counter sensor data.

18. The non-transitory computer-readable medium of claim 15 , wherein the determining, from the pseudo-video frame, the sensor data from the one or more sensors operation comprises: decoding the sensor data from: a pattern of the pseudo-video frame, a color of the pseudo-video frame, an audio portion of the pseudo-video frame, or a watermark added to the pseudo-video frame.

19. The non-transitory computer-readable medium of claim 15 , wherein the standard video picture encoding packet is based on: MPEG-4 Part 2 protocol, YUY2 protocol, or H.264 protocol.

20. The non-transitory computer-readable medium of claim 19 , wherein the standard video picture encoding packet is an MPEG-4 Part 2 packet, and the recovering the non-standard video data from the MPEG-4 Part 2 packet operation comprises: decoding the non-standard video data from a data field of the MPEG-4 Part 2 packet.

Assignees

• Elo Touch Solutions Inc

Inventors

• Perry Brian
• Ekanayake Asela
• Uddin Fareed
• Zhang Jiachi

Classifications

• H04N21/8358

  involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)} · CPC title

• H04N21/4381

  Recovering the multiplex stream from a specific network, e.g. recovering MPEG packets from ATM cells (transmission of MPEG streams over ATM H04L12/5601) · CPC title

• H04N21/43632 Primary

  involving a wired protocol, e.g. IEEE 1394 (high-speed IEEE 1394 serial bus H04L12/40052) · CPC title

• H04N21/4355

  involving reformatting operations of additional data, e.g. HTML pages on a television screen (optimising the visualization of content for information retrieval from the Internet G06F16/9577; adaptation of message content in packet-switching networks H04L51/066; media handling at the source in data packet switching networks H04L65/764) · CPC title

• H04N21/42202

  environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes · CPC title