Image processing

Patent metadata

Field	Value
Publication number	US-12413752-B2
Application number	US-201816769798-A
Country	US
Kind code	B2
Filing date	Dec 6, 2018
Priority date	Dec 6, 2017
Publication date	Sep 9, 2025
Grant date	Sep 9, 2025

Abstract

First compressed data is decoded to obtain a representation of an image at a first level of quality which is output for display. In response to a predetermined trigger event, second compressed data is decoded to obtain reconstruction data, and the reconstruction data is used to reconstruct a representation of part of the image at a second, higher level of quality using the representation at the first level of quality. The representation of part of the image is output for display at the second level of quality.

First claim

The invention claimed is:

1. A method for facilitating a progressive reconstruction chain of an image by processing a single compressed data stream for the image in a manner so as to progressively derive different quality representations of the image and in a manner so as to enable different regions of one or more of the representations of the image to be reconstructed at different levels of quality, such that the one or more representations of the image are reconstructed during the reconstruction chain to include non-uniform levels of quality, the method being performed by a browser engine and comprising:
receiving, within the single compressed data stream, first compressed data that, when decoded, is useable to obtain a first representation of the image at a first level of quality having a first image resolution, wherein the first representation of the image includes a thumbnail version of the image;
decoding the first compressed data to obtain the first representation of the image at the first level of quality such that the thumbnail version of the image is obtained;
causing the thumbnail version of the image to be displayed on a webpage and at a particular size;
decoding second compressed data to obtain first reconstruction data usable to generate a preliminary representation of the image, wherein:
the preliminary representation of the image includes a first original subpart and a second original subpart,
the first and second original subparts are reconstructed and displayed at a second level of quality such that the preliminary representation of the image has a uniform level of quality, and
the second compressed data is (i) downloaded in response to a predetermined trigger event comprising a user selection of the displayed thumbnail version of the image and then subsequently decoded or, alternatively, (ii) received prior to the predetermined trigger event and then decoded after the predetermined trigger event;

decoding third compressed data to obtain second reconstruction data useable to enhance the second original subpart of the preliminary representation of the image from the second level of quality to a third, higher level of quality comprising a higher image resolution, wherein the second original subpart is less than an entirety of the preliminary representation of the image, resulting in generation of an enhanced representation of the image; and
using the second reconstruction data to enhance said second original subpart of the preliminary representation of the image to create the enhanced representation of the image, which includes an enhanced subpart;
causing the enhanced representation of the image to be displayed on the webpage,
wherein:
the enhanced subpart is displayed at the higher image resolution in place of the second original subpart of the preliminary representation of the image, such that the enhanced representation of the image is a subsequently reconstructed version of the preliminary representation of the image and is displayed in a manner so as to include non-uniform levels of quality, and
as a result of using the single compressed data stream, the thumbnail version of the image is a part of the reconstruction chain of the enhanced representation of the image as opposed to the thumbnail version of the image being streamed separately.

2. A method according to claim 1 , wherein the image is a still image.

3. The method according to claim 1 , wherein decoding the third compressed data and using the second reconstruction data are performed in response to determining that the first level of quality is less than or equal to one or more threshold levels of quality.

4. The method according to of claim 1 , wherein the third compressed data is decoded after the thumbnail version of the image is displayed.

5. The method according to claim 1 , wherein the third compressed data is received from a server system in response to a request sent to the server system.

6. The method according to claim 1 , wherein the thumbnail version of the image is a selected target region of a larger image.

7. The method according to claim 6 , the method comprising selecting the target region using the browser engine and/or by a client device running the browser engine.

8. The method according to claim 6 , wherein the target region corresponds to a visible part of the webpage.

9. The method according to claim 6 , wherein the target region is selected based on an operating characteristic of the browser engine and/or an operating characteristic of a client device running the browser engine.

10. The method according to claim 1 , wherein the third compressed data is received after the thumbnail version of the image is displayed.

11. A non-transitory computer-readable medium comprising instructions that are executable to cause one or more processors to:
Receive, within a single compressed data stream, first compressed data that, when decoded, is useable to obtain a first representation of an image at a first level of quality having a first image resolution, wherein the first representation of the image includes a thumbnail version of the image;
decode the first compressed data to obtain the first representation of the image at the first level of quality such that the thumbnail version of the image is obtained;
cause the thumbnail version of the image to be displayed on a webpage and at a particular size;
decode second compressed data to obtain first reconstruction data usable to generate a preliminary representation of the image, wherein:
the preliminary representation of the image includes a first original subpart and a second original subpart,
the first and second original subparts are reconstructed and displayed at a second level of quality such that the preliminary representation of the image has a uniform level of quality, and
the second compressed data is (i) downloaded in response to a predetermined trigger event comprising a user selection of the displayed thumbnail version of the image and then subsequently decoded or, alternatively, (ii) received prior to the predetermined trigger event and then decoded after the predetermined trigger event;

decode third compressed data to obtain second reconstruction data useable to enhance the second original subpart of the preliminary representation of the image from the second level of quality to a third, higher level of quality comprising a higher image resolution, wherein the second original subpart is less than an entirety of the preliminary representation of the image, resulting in generation of an enhanced representation of the image; and
use the second reconstruction data to enhance said second original subpart of the preliminary representation of the image to create the enhanced representation of the image, which includes an enhanced subpart;
cause the enhanced representation of the image to be displayed on the webpage, wherein:
the enhanced subpart is displayed at the higher image resolution in place of the second original subpart of the preliminary representation of the image, such that the enhanced representation of the image is a subsequently reconstructed version of the preliminary representation of the image and is displayed in a manner so as to include non-uniform levels of quality, and
as a result of using the single compressed data stream, the thumbnail version of the image is a part of a reconstruction chain of the enhanced representation of the image as opposed to the thumbnail version of the image being streamed separately.

Assignees

• V Nova Int Ltd

Inventors

• Makeev Ivan
• Keszthelyi Balázs
• Poularakis Stergios
• Sanna Michele
• Ettinger Robert

Classifications

• H04N19/46

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title

• H04N19/187

  the unit being a scalable video layer · CPC title

• H04N19/17

  the unit being an image region, e.g. an object · CPC title

• H04N19/167

  Position within a video image, e.g. region of interest [ROI] · CPC title

• H04N19/154

  Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) · CPC title