Human-computer interaction method and system of display device

Patent metadata

Field	Value
Publication number	US-12368918-B2
Application number	US-202218022483-A
Country	US
Kind code	B2
Filing date	Mar 29, 2022
Priority date	Mar 29, 2022
Publication date	Jul 22, 2025
Grant date	Jul 22, 2025

Abstract

Disclosed are a human-computer interaction method and system of a display device, which are used for providing a new interaction manner. A main control module is configured to receive an interactive instruction of a user and generate OSD data, and a data processing module is configured to superimpose and display a received video stream and the OSD data. The human-computer interaction system includes a data source generation module, a main control module and a data processing module. The data source generation module is configured to generate a video stream and send the video stream to the data processing module. The main control module is configured to receive an interactive instruction sent by a user, generate OSD data according to the interactive instruction, and transmit the OSD data to the data processing module. The data processing module is configured to superimpose the received video stream with the OSD data, and output the superimposed video stream to a display end for displaying to make a response to the interactive instruction sent by the user.

First claim

What is claimed is:

1. A human-computer interaction system of a display device, comprising a data source generation module, a main control module, a data processing module, and a data storage module, wherein
the data source generation module is configured to generate a video stream and send the video stream to the data processing module;
the main control module is configured to receive an interactive instruction sent by a user, generate On Screen Display (OSD) data according to the interactive instruction, and transmit the OSD data to the data processing module;
the data processing module is configured to superimpose the received video stream with the OSD data, and output the superimposed video stream to a display end for displaying to make a response to the interactive instruction sent by the user;
the data storage module is configured to double, in a manner of storing one frame of video stream and reading two frames of video stream, a frame rate of the video stream generated by the data source generation module, and send the video stream having a doubled frame rate to the data processing module; and
the data processing module is configured to superimpose the received video stream having the doubled frame rate with the OSD data.

2. The system according to claim 1 , wherein the main control module receives an interactive instruction sent by a user, which comprises:
receiving, by the main control module, the interactive instruction sent, through a key, by the user; and/or,
receiving, by the main control module, the interactive instruction sent, through a remote terminal, by the user.

3. The system according to claim 2 , wherein said receiving, by the main control module, the interactive instruction sent, through the remote terminal, by the user comprises:
receiving, by the main control module, the interactive instruction sent, through the remote terminal, by the user via the data source generation module;
wherein the remote terminal and the data source generation module are in communication connection through a wireless network; and
the main control module and the data source generation module are in communication connection based on an interface standard for serial data communication.

4. The system according to claim 1 , wherein the data processing module superimposes the received video stream with the OSD data, which comprises:
superimposing the received video stream with the OSD data received at a second time by the data processing module under a condition that a time difference between the OSD data received by the data processing module for two consecutive times is less than a threshold.

5. The system according to claim 1 , wherein the data processing module superimposes the received video stream having the doubled frame rate with the OSD data, which comprises:
determining, by the data processing module, a read bit width of the OSD data according to bit widths of video frames in the video stream having the doubled frame rate; and
reading, by the data processing module, OSD data according to the read bit width, and superimposing the OSD data read at each time with the video frames in the video stream having the doubled frame rate in sequence.

6. The system according to claim 1 , wherein the data processing module superimposes the received video stream with the OSD data, which comprises:
taking, by the data processing module, a video frame received after receiving the OSD data as a start frame for superimposing;
determining, according to a display duration of the OSD data, a quantity of frames of the video stream for superimposing; and
superimposing the video stream with the OSD data according to the start frame and the quantity of frames.

7. The system according to claim 1 , wherein the main control module is configured to transmit the OSD data to the data processing module through a serial peripheral interface (SPI).

8. The system according to claim 1 , wherein the data processing module superimposes the received video stream with the OSD data, which comprises:
verifying, by the data processing module, the received OSD data, and superimposing the received video stream with the OSD data after it is determined that the verification succeeds.

9. The system according to claim 1 , wherein the data processing module outputs the superimposed video stream to a display end for displaying, which comprises:
performing, by the data processing module, format conversion on the superimposed video stream according to a pre-defined format; and
outputting the video stream subjected to the format conversion to the display end for displaying.

10. The system according to claim 1 , wherein the main control module transmits the OSD data to the data processing module, which comprises:
sending, by the data processing module, an enable signal to the main control module after a determination that the received video stream is displayed at the display end according to a preset requirement, so as to instruct the main control module to start to execute an OSD function; and
transmitting, by the main control module, the OSD data to the data processing module after receiving the enable signal.

11. The system according to claim 1 , wherein the interactive instruction comprises an update instruction;
the main control module is further configured to receive the update instruction sent by the user, generate a parameter according to the update instruction, and transmit the parameter to the data processing module; and
the data processing module is configured to control an update of data corresponding to the parameter according to the received parameter.

12. A human-computer interaction method of a display device, applied to the system according to claim 1 , the method comprising:
generating, by the data source generation module, a video stream, and sending the video stream to the data processing module;
receiving, by a main control module, an interactive instruction sent by a user, generating OSD data according to the interactive instruction, and transmitting the OSD data to the data processing module; and
superimposing, by the data processing module, the received video stream with the OSD data, and outputting the superimposed video stream to a display end for displaying to make a response to the interactive instruction sent by the user.

13. The method according to claim 12 , wherein said receiving, by the main control module, the interactive instruction sent by the user comprises:
receiving, by the main control module, the interactive instruction sent, through a key, by the user; and/or,
receiving, by the main control module, the interactive instruction sent, through a remote terminal, by the user.

14. The method according to claim 12 , wherein said superimposing, by the data processing module, the received video stream with the OSD data comprises:
superimposing, by the data processing module, the received video stream with the OSD data received at a second time under a condition that a time difference between the OSD data received for two consecutive times is less than a threshold.

15. The method according to claim 12 , further comprising:
doubling, in a manner of storing one frame of video stream and reading two frames of video stream by the data storage module, a frame rate of the video stream generated by the data source generation module, and sending the video stream having a doubled frame rate to the data processing module, so as to instruct the data processing module to superimpose the received video stream having the doubled frame rate with the OSD data.

16. The method according to

Assignees

• Beijing Boe Optoelectronics Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Liu Xiantao
• Wang Yonghui
• Meng Chen
• Fu Bo
• Hu Zhong
• Pang Xiaotian
• Liu Jiarong
• Xin Jiajia
• Sun Guosheng

Classifications

• H04N21/234381

  by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping · CPC title

• H04N21/431

  Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering · CPC title

• H04N5/445

  for displaying additional information (H04N5/50 takes precedence) · CPC title

• H04N21/4316 Primary

  for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window · CPC title