Display apparatus and operating method thereof

Patent metadata

Field	Value
Publication number	US-12518667-B2
Application number	US-202318092714-A
Country	US
Kind code	B2
Filing date	Jan 3, 2023
Priority date	Sep 30, 2021
Publication date	Jan 6, 2026
Grant date	Jan 6, 2026

Abstract

Provided are a display apparatus and an operating method thereof. The display apparatus includes a display, a reproducer configured to reproduce content, a memory storing one or more instructions, and a processor configured to execute the one or more instructions stored in the memory to: obtain a characteristic of content requested to be reproduced; obtain, as a first latency threshold serving as a reference value for a latency control operation, a first value based on the obtained characteristic of the content; measure latency of the content during reproduction of the content by the reproducer; determine whether the measured latency of the content is greater than the first value; and based on determining that the measured latency of the content is greater than the first value, control the reproducer to drop at least some of frames corresponding to the content.

First claim

What is claimed is:

1 . A display apparatus comprising:
a display; a reproducer configured to reproduce content; a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to: based on content requested to be reproduced being a game content, identify a category of the game content from a plurality of categories; identify a latency threshold corresponding to the category, each category of the plurality of categories having a corresponding latency threshold; measure current latency of the content during reproduction of the content by the reproducer based on a number of frames stored in a buffer; determine whether the current latency of the content which is measured based on the number of frames stored in the buffer is greater than the latency threshold corresponding to the category; and based on determining that the current latency of the content is greater than the latency threshold, control the reproducer to drop at least some of frames corresponding to the content.

2 . The display apparatus of claim 1 , wherein the processor is further configured to execute the one or more instructions to:
determine a frame drop ratio corresponding to the category of the game content; and control the reproducer to drop the at least some of frames according to the determined frame drop ratio, based on determining that the current latency of the content is greater than the latency threshold.

3 . The display apparatus of claim 1 , wherein the processor is further configured to execute the one or more instructions to:
obtain a second latency threshold for a buffer flush operation corresponding to the category of the game content; and based on the current latency of the content being greater than the second latency threshold, request a source providing the content to provide frames corresponding to the content, and control the reproducer to perform the buffer flush operation so as to empty the buffer.

4 . The display apparatus of claim 3 , wherein the processor is further configured to execute the one or more instructions to, based on the current latency of the content being greater than the second latency threshold, request the source providing the content to provide an I-frame among the frames corresponding to the content.

5 . The display apparatus of claim 4 , wherein the processor is further configured to execute the one or more instructions to control the reproducer to perform buffer flushing based on the I-frame being received from the source.

6 . The display apparatus of claim 1 , wherein the reproducer comprises:
a main buffer configured to receive and store frames corresponding to the content; a decoder configured to decode frames output from the main buffer; a display buffer configured to receive and store the decoded frames; a renderer configured to receive the stored decoded frames from the display buffer, and to render the decoded frames received from the display buffer; and a latency handler configured to manage the current latency of the content.

7 . The display apparatus of claim 6 , wherein the latency handler is further configured to measure the current latency of the content, based on frames stored in the main buffer and frames stored in the display buffer.

8 . The display apparatus of claim 6 , wherein the display buffer is further configured to, based on determining that the current latency of the content is greater than the latency threshold, drop at least some of frames stored in the display buffer at a frame drop ratio corresponding to a latency reduction speed determined based on the obtained category of the game content.

9 . The display apparatus of claim 6 , wherein
the processor is further configured to execute the one or more instructions to:
obtain a second latency threshold for a buffer flush operation, based on the obtained category of the game content; and
the main buffer is further configured to, based on the current latency of the content being greater than the second latency threshold, perform the buffer flush operation to delete frames stored in the main buffer.

10 . An operating method of a display apparatus, the operating method comprising:
based on content requested to be reproduced being a game content, identifying a category of the game content from a plurality of categories; identifying a latency threshold corresponding to the category, each category of the plurality of categories having a corresponding latency threshold; measuring current latency of the content during reproduction of the content based on a number of frames stored in a buffer; determining whether the current latency of the content which is measured based on the number of frames stored in the buffer is greater than the latency threshold corresponding to the category; and based on determining that the current latency of the content is greater than the latency threshold, controlling at least some of frames corresponding to the content to be dropped.

11 . The operating method of claim 10 , further comprising:
determining a frame drop ratio corresponding to the category of the game content; and based on determining that the current latency of the content is greater than the latency threshold, controlling at least some of frames to be dropped according to the determined frame drop ratio.

12 . The operating method of claim 10 , further comprising:
obtaining a second latency threshold for a buffer flush operation corresponding to the category of the game content; and requesting a source providing the content to provide the frames corresponding to the content and controlling a reproducer to perform the buffer flush operation so as to empty the buffer, when the current latency of the content is greater than the second latency threshold.

13 . The operating method of claim 12 , further comprising, based on the current latency of the content being greater than the second latency threshold, requesting the source providing the content to provide an I-frame among the frames corresponding to the content.

14 . The operating method of claim 13 , further comprising controlling buffer flushing to be performed based on the I-frame being received from the source.

15 . A computer-readable recording medium having recorded thereon a program including one or more instructions to implement, on a computer, an operating method of a display apparatus, wherein the operating method of the display apparatus comprises:
based on content requested to be reproduced being a game content, identifying a category of the game content from a plurality of categories; identifying a latency threshold corresponding to the category, each category of the plurality of categories having a corresponding latency threshold; measuring current latency of the content during reproduction of the content by the reproducer based on a number of frames stored in a buffer; determining whether the current latency of the content which is measured based on the number of frames stored in the buffer is greater than the latency threshold corresponding to the category; and based on determining that the current latency of the content is greater than the latency threshold, controlling at least some of frames corresponding to the content to be dropped.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Ko Euna
• Kim Yunsu
• Kim Sehyun
• Lee Jongin

Classifications

• H04N21/44004

  involving video buffer management, e.g. video decoder buffer or video display buffer · CPC title

• G09G2370/02

  Networking aspects · CPC title

• G09G2360/18

  Use of a frame buffer in a display terminal, inclusive of the display panel · CPC title

• A63F2300/534

  for network load management, e.g. bandwidth optimization, latency reduction · CPC title

• H04N21/8455

  involving pointers to the content, e.g. pointers to the I-frames of the video stream · CPC title