Vertex pixel buffer

Patent metadata

Field	Value
Publication number	US-10430983-B2
Application number	US-201715614310-A
Country	US
Kind code	B2
Filing date	Jun 5, 2017
Priority date	Jun 5, 2017
Publication date	Oct 1, 2019
Grant date	Oct 1, 2019

Abstract

Encoding pixel information for pixels of an image. A method includes accessing information defining high-frequency image data correlated with pixels. The method further includes for each pixel, identifying if a vertex from the high-frequency image data is located in that pixel based on analysis of the high-frequency data correlated with the pixel. The method further includes, for one or more pixels in which a vertex is located, identifying the location of the vertex. The method further includes encoding the vertex location into image pixel data.

First claim

What is claimed is:

1. An image processing system for encoding pixel data for pixels of an image, the image processing system comprising:
a feature detection system, wherein the feature detection system is configured to access information defining high-frequency data corresponding to locations on a pixel map of the pixels and extract at least sub-pixel vertex locations from the high-frequency data for pixels; and
an encoder coupled to the feature detection system configured to encode the sub-pixel vertex locations into pixel data for the pixels, such that the pixel data for the pixels includes, for each pixel, a discrete data element which includes color data and feature data, the feature data including a sub-pixel vertex location for the high frequency data for the pixel.

2. The image processing system of claim 1 , wherein the feature detection system comprises a secondary color identifier that is further configured to extract secondary color information from the high-frequency data and correlate the secondary color information to the pixels, and wherein the encoder is further configured to encode the secondary color information into the discrete data element.

3. The image processing system of claim 1 , wherein:
the high-frequency data comprises geometric data; and
wherein the feature detection system is configured to extract a location of a geometric vertex of a geometric shape in the geometric data.

4. The image processing system of claim 1 , wherein:
the high-frequency data comprises geometric data;
wherein the feature detection system comprises an edge intersection locator that is configured to identify pixel edge intersections from a geometric shape in the geometric data.

5. The image processing system of claim 1 ,
wherein the feature detection system comprises a vertex connectivity calculator configured to compute connectivity information defining connectivity between a sub-pixel vertex in a first pixel of the pixels and sub-pixel vertices in other pixels of the pixels that are adjacent to the first pixel, wherein the connectivity information approximates shape edges in the high-frequency data.

6. The image processing system of claim 1 , wherein the high-frequency data comprises results of a shading function.

7. A computer system comprising:
one or more processors; and
one or more computer-readable media having stored thereon instructions that are executable by the one or more processors to configure the computer system to encode feature data into pixel definitions for an image, including instructions that are executable to configure the computer system to perform at least the following:
access information defining high-frequency data corresponding to locations on a pixel map of pixels;
identify feature data comprising sub-pixel vertex locations in the pixels from the high-frequency data for the pixels; and
encode the sub-pixel vertex locations into pixel data for the pixels, such that the pixel data for the pixels includes, for each pixel, a discrete data element which includes color data and feature data, the feature data including a sub-pixel vertex location for the high frequency data for the pixel.

8. The computer system of claim 7 , wherein the one or more computer-readable media further have stored thereon instructions that are executable by the one or more processors to configure the computer system to identify the sub-pixel vertex locations using a corner-finding algorithm.

9. The computer system of claim 7 , wherein the one or more computer-readable media further have stored thereon instructions that are executable by the one or more processors to configure the computer system to identify the sub-pixel vertex locations using a gradient descent algorithm that optimizes connectivity between a predetermined set of pixels from among the pixels.

10. The computer system of claim 9 , wherein the predetermined set of pixels comprises pixels adjacent to a pixel where a sub-pixel vertex has been located.

11. The computer system of claim 7 , wherein the one or more computer-readable media further have stored thereon instructions that are executable by the one or more processors to configure the computer system to identify the sub-pixel vertex locations using a calculated or sampled derivative of the high-frequency data.

12. A method of encoding pixel data for pixels of an image, the method comprising:
accessing information defining high-frequency data corresponding to locations on a pixel map of the pixels;
for each pixel, identifying if a sub-pixel vertex can be located in that pixel based on analysis of the high-frequency data corresponding to the pixel;
for one or more pixels in which a sub-pixel vertex can be located, identifying the location of the sub-pixel vertex; and
encoding in pixel data for the one or more pixels in which a sub-pixel vertex can be located, the sub-pixel vertex location such that pixel data for the pixels includes, for each pixel, a discrete data element which includes color data and feature data, the feature data including a sub-pixel vertex location for the high frequency data for the pixel.

13. The method as recited in claim 12 , further comprising:
for the one or more pixels in which a sub-pixel vertex can be located, identifying secondary color information by identifying a dominant color and a secondary color; and
encoding secondary color information into the pixel data.

14. The method as recited in claim 12 , wherein:
the high-frequency data for each pixel comprises geometric data; and
wherein identifying the location of the sub-pixel vertex comprises identifying a geometric vertex of a geometric shape located in the pixel.

15. The method as recited in claim 14 , further comprising:
computing connectivity information defining connectivity between the sub-pixel vertex selected in the pixel and sub-pixel vertices in other pixels that are part of the geometric shape; and
encoding the connectivity information into the pixel data.

16. The method as recited in claim 12 , wherein:
the high-frequency data comprises geometric data; and
wherein identifying the location of the sub-pixel vertex comprises identifying pixel edge intersections from a geometric shape in the geometric data and selecting a point along a line connecting the pixel edge intersections as the sub-pixel vertex.

17. The method as recited in claim 12 , wherein:
the high-frequency data comprises texture data; and
wherein the sub-pixel vertex location for at least one of the pixels is identified from the texture data using a corner-finding algorithm.

18. The method as recited in claim 17 , further comprising:
for the sub-pixel vertex location identified by the corner-finding algorithm, computing connectivity information defining connectivity between the sub-pixel vertex location and connected vertices located in other pixels; and
encoding the connectivity information into the pixel data.

19. The method as recited in claim 12 , wherein
the high-frequency data comprises texture data;
wherein the sub-pixel vertex location is computed using a gradient descent algorithm; and
wherein the gradient descent algorithm optimizes connectivity between a predetermined set of pixels from among the pixels.

20. The method as recited in claim 12 , wherein
the high-frequency data comprises results of executing a shading function; and
the sub-pixel vertex location is computed using a calculated or sampled minimization of a derivative of the high frequency data.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Michail Ashraf Ayman
• Boulton Michael George

Classifications

• G06T9/00

  Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) · CPC title

• G06T11/40 Primary

  Filling planar surfaces by adding surface attributes, e.g. adding colours or textures · CPC title