Analytic image format for visual computing

Patent metadata

Field	Value
Publication number	US-11068757-B2
Application number	US-201816142468-A
Country	US
Kind code	B2
Filing date	Sep 26, 2018
Priority date	Dec 28, 2017
Publication date	Jul 20, 2021
Grant date	Jul 20, 2021

Abstract

In one embodiment, an apparatus comprises a storage device and a processor. The storage device stores a plurality of images captured by a camera. The processor: accesses visual data associated with an image captured by the camera; determines a tile size parameter for partitioning the visual data into a plurality of tiles; partitions the visual data into the plurality of tiles based on the tile size parameter, wherein the plurality of tiles corresponds to a plurality of regions within the image; compresses the plurality of tiles into a plurality of compressed tiles, wherein each tile is compressed independently; generates a tile-based representation of the image, wherein the tile-based representation comprises an array of the plurality of compressed tiles; and stores the tile-based representation of the image on the storage device.

First claim

What is claimed is:

1. An apparatus, comprising:
a storage device to store a plurality of images, wherein the plurality of images are to be stored in a tile-based image format in an array database; and
a processor to:
receive a request to store an image in the tile-based image format, wherein the tile-based image format is to represent the image as a corresponding array of compressed tiles to be stored in the array database;
determine a set of parameters for storing the image in the tile-based image format, wherein the set of parameters comprise:
one or more tile size parameters for partitioning the image into a plurality of tiles; and
one or more compression parameters for compressing the plurality of tiles;

partition the image into the plurality of tiles based on the one or more tile size parameters;
compress the plurality of tiles into a plurality of compressed tiles based on the one or more compression parameters, wherein each tile of the plurality of tiles is compressed independently; and
store the plurality of compressed tiles in the corresponding array of compressed tiles in the array database.

2. The apparatus of claim 1 , wherein the processor to determine the set of parameters for storing the image in the tile-based image format is further to:
generate a plurality of tile-based representations of at least a portion of the image, wherein the plurality of tile-based representations is generated based on a plurality of tile size parameters;
evaluate a performance of the plurality of tile-based representations based on one or more image processing operations;
identify a particular tile-based representation that provides an optimal performance, wherein the particular tile-based representation is identified from the plurality of tile-based representations; and
identify the one or more tile size parameters associated with the particular tile-based representation.

3. The apparatus of claim 1 , wherein the processor to determine the set of parameters for storing the image in the tile-based image format is further to:
generate a plurality of tile-based representations of at least a portion of the image, wherein the plurality of tile-based representations is generated based on a plurality of tile size parameters and a plurality of compression parameters;
evaluate a performance of the plurality of tile-based representations based on one or more image processing operations;
identify a particular tile-based representation that provides an optimal performance, wherein the particular tile-based representation is identified from the plurality of tile-based representations;
identify the one or more tile size parameters associated with the particular tile-based representation; and
identify the one or more compression parameters associated with the particular tile-based representation.

4. The apparatus of claim 1 , wherein the processor to partition the image into the plurality of tiles based on the one or more tile size parameters is further to:
identify one or more regions of interest within the image; and
recursively partition the image into the plurality of tiles, wherein the image is partitioned into the plurality of tiles in a plurality of recursive stages, wherein each recursive stage produces a plurality of intermediate tiles, and wherein each intermediate tile is to be further partitioned in a subsequent recursive stage if:
the intermediate tile at least partially comprises the one or more regions of interest; and
partitioning the intermediate tile produces at least one smaller tile that does not comprise the one or more regions of interest.

5. The apparatus of claim 4 , wherein the processor to recursively partition the image into the plurality of tiles is further to:
merge a plurality of contiguous tiles within the plurality of tiles, wherein the plurality of contiguous tiles does not comprise the one or more regions of interest.

6. The apparatus of claim 1 , wherein the processor to determine the set of parameters for storing the image in the tile-based image format is further to:
identify one or more regions of interest within the image;
identify one or more first tile sizes for partitioning the image into one or more first tiles, wherein the one or more first tiles comprise the one or more regions of interest; and
identify one or more second tile sizes for partitioning the image into one or more second tiles, wherein the one or more second tiles do not comprise the one or more regions of interest.

7. The apparatus of claim 1 , wherein the processor is further to:
retrieve, via the storage device, a first representation of the image, wherein visual data is encoded and compressed within the first representation of the image based on a first image format;
decompress the first representation of the image to extract encoded visual data; and
decode the encoded visual data to extract the visual data associated with the image.

8. The apparatus of claim 1 , wherein the processor is further to:
receive a request to access a region of interest within the image;
retrieve, via the storage device, a subset of the plurality of compressed tiles associated with the tile-based image format of the image, wherein the subset of the plurality of compressed tiles comprises the region of interest within the image; and
decompress the subset of the plurality of compressed tiles to extract the region of interest.

9. The apparatus of claim 1 , wherein the processor to determine the set of parameters for storing the image in the tile-based image format is further to:
determine the one or more tile size parameters, wherein the one or more tile size parameters indicate one or more optimal tile sizes for partitioning the image into the plurality of tiles.

10. The apparatus of claim 1 , wherein the one or more compression parameters indicate one or more compression types for compressing the plurality of tiles.

11. A system, comprising:
one or more cameras to capture a plurality of images;
a storage device to store the plurality of images, wherein the plurality of images are to be stored in a tile-based image format in an array database; and
one or more processing devices to:
receive a request to store an image captured by the one or more cameras in the tile-based image format, wherein the tile-based image format is to represent the image as a corresponding array of compressed tiles to be stored in the array database;
determine a set of parameters for storing the image in the tile-based image format, wherein the set of parameters comprise:
one or more tile size parameters for partitioning the image into a plurality of tiles; and
one or more compression parameters for compressing the plurality of tiles;

partition the image into the plurality of tiles based on the one or more tile size parameters;
compress the plurality of tiles into a plurality of compressed tiles based on the one or more compression parameters, wherein each tile of the plurality of tiles is compressed independently; and
store the plurality of compressed tiles in the corresponding array of compressed tiles in the array database.

12. The system of claim 11 , wherein the one or more processing devices to determine the set of parameters for storing the image in the tile-based image format are further to:
generate a plurality of tile-based representations of at least a portion of the image, wherein the plurality of tile-based representations is generated based on a plurality of tile size parameters;
evaluate a performance of the plurality of tile-based representations based on one or more image processing operations;
identify a particular tile-based representation that pro

Assignees

• Intel Corp

Inventors

• Strong Christina R
• Gupta Vishakha
• Remis Luis Carlos Maria
• Datta Kushal
• Raghunath Arun

Classifications

• G06V10/771

  Feature selection, e.g. selecting representative features from a multi-dimensional feature space · CPC title

• G06V30/274

  Syntactic or semantic context, e.g. balancing · CPC title

• G06V20/00 Primary

  Scenes; Scene-specific elements (control of digital cameras H04N23/60) · CPC title

• G06F18/24323

  Tree-organised classifiers · CPC title

• G06F18/211

  Selection of the most significant subset of features · CPC title