Rotating bit values based on a data structure while generating a large, non-compressible data stream

Patent metadata

Field	Value
Publication number	US-10163371-B1
Application number	US-201715420633-A
Country	US
Kind code	B1
Filing date	Jan 31, 2017
Priority date	Sep 17, 2014
Publication date	Dec 25, 2018
Grant date	Dec 25, 2018

Abstract

Generating non-compressible data streams is disclosed, including: receiving a sequence comprising a plurality of byte values calculated from an initialization parameter and a constrained prime number; determining a data structure index from a plurality of bits within at least one of the plurality of byte values; retrieving a rotation value from a data structure, wherein the rotation value is stored in the data structure at the data structure index; and rotating a portion of the sequence based on a rotation value to form a rotated sequence, wherein the rotated sequence comprises byte values substantially defeating a predictive compression algorithm.

First claim

What is claimed is:

1. A system for generating a large non-compressible data stream by rotating bit values, comprising:
a processor configured to:
receive an initialization parameter;
determine a first constrained prime number and a second constrained prime number, wherein a constrained prime number comprises a plurality of component values, wherein each of the plurality of component values comprises a prime number, wherein each of the plurality of component values is different;
generate a non-compressible data stream comprising a plurality of data blocks at least in part by:
generate a first non-compressible sequence based at least in part on the initialization parameter and the first constrained prime number;
generate a second non-compressible sequence based at least in part on the initialization parameter and the second constrained prime number, wherein the first and second non-compressible sequences are each comprised of a non-repeating sequence of numbers; and
merge the first non-compressible sequence and the second non-compressible sequence to generate the non-compressible data stream, wherein values of the non-compressible data stream alternate between values of the first non-compressible sequence and values of the second non-compressible sequence;

determine a data structure index from a plurality of bits within at least one of a plurality of byte values from the non-compressible data stream;
retrieve a rotation value from a data structure, wherein the rotation value is stored in the data structure at the data structure index;
rotate a portion of the non-compressible data stream based on the rotation value to form a rotated non-compressible data stream, the rotated non-compressible data stream comprising the plurality of data blocks; and
send the rotated non-compressible data stream to be stored at a storage device, wherein the storage device is configured to store all of the plurality of data blocks in response to determining that none of the data blocks have been already stored at the storage device;
receive restored data associated with the rotated non-compressible data stream from the storage device, wherein the restored data associated with the non-compressible data stream comprises the plurality of data blocks;
determine the first constrained prime number based at least in part on a difference between a first pair of non-consecutive values from the restored data associated with the rotated non-compressible data stream;
determine the second constrained prime number based at least in part on a difference between a second pair of non-consecutive values from the restored data associated with the rotated non-compressible data stream; and
verify an accuracy and/or reliability of the storage device, wherein to verify the accuracy and/or reliability of the storage device, the restored data associated with the rotated non-compressible data stream is verified by using the determined first constrained prime number and the determined second constrained prime number; and

a memory coupled to the processor and configured to provide the processor with instructions.

2. The system of claim 1 , wherein the data structure comprises an array of constrained prime numbers.

3. The system of claim 1 , wherein the data structure comprises an array of prime numbers.

4. The system of claim 1 , wherein the portion of the non-compressible data stream is rotated left.

5. The system of claim 1 , wherein the portion of the non-compressible data stream is rotated right.

6. A method for generating a large non-compressible data stream by rotating bit values, comprising:
receiving an initialization parameter;
determining a first constrained prime number and a second constrained prime number, wherein a constrained prime number comprises a plurality of component values, wherein each of the plurality of component values comprises a prime number, wherein each of the plurality of component values is different;
generating a non-compressible data stream comprising a plurality of data blocks at least in part by:
generating a first non-compressible sequence based at least in part on the initialization parameter and the first constrained prime number;
generating a second non-compressible sequence based at least in part on the initialization parameter and the second constrained prime number, wherein the first and second non-compressible sequences are each comprised of a non-repeating sequence of numbers; and
merging the first non-compressible sequence and the second non-compressible sequence to generate the non-compressible data stream, wherein values of the non-compressible data stream alternate between values of the first non-compressible sequence and values of the second non-compressible sequence;

determining a data structure index from a plurality of bits within at least one of a plurality of byte values from the non-compressible data stream;
retrieving a rotation value from a data structure, wherein the rotation value is stored in the data structure at the data structure index;
rotating a portion of the non-compressible data stream based on the rotation value to form a rotated non-compressible data stream, the rotated non-compressible data stream comprising the plurality of data blocks; and
sending the rotated non-compressible data stream to be stored at a storage device, wherein the storage device is configured to store all of the plurality of data blocks in response to determining that none of the data blocks have been already stored at the storage device;
receiving restored data associated with the rotated non-compressible data stream from the storage device, wherein the restored data associated with the non-compressible data stream comprises the plurality of data blocks;
determining the first constrained prime number based at least in part on a difference between a first pair of non-consecutive values from the restored data associated with the rotated non-compressible data stream;
determining the second constrained prime number based at least in part on a difference between a second pair of non-consecutive values from the restored data associated with the rotated non-compressible data stream; and
verifying an accuracy and/or reliability of the storage device, wherein to verify the accuracy and/or reliability of the storage device, the restored data associated with the rotated non-compressible data stream is verified by using the determined first constrained prime number and the determined second constrained prime number.

7. The method of claim 6 , wherein the data structure comprises an array of constrained prime numbers.

8. The method of claim 6 , wherein the data structure comprises an array of prime numbers.

9. The method of claim 6 , wherein the portion of the non-compressible data stream is rotated left.

10. The method of claim 6 , wherein the portion of the non-compressible data stream is rotated right.

11. A computer program product for generating a large non-compressible data stream by rotating bit values, the computer program product embodied in a nontransitory computer readable storage medium and comprising computer instructions for:
receiving an initialization parameter;
determining a first constrained prime number and a second constrained prime number, wherein a constrained prime number comprises a plurality of component values, wherein each of the plurality of component values comprises a prime number, wherein each of the plurality of component values is different;
generating a non-compressible data stream comprising a plurality of data blocks at least in part by:
generating a first non-compressible sequence based at least in part on the initialization parameter and the fir

Assignees

• Emc Ip Holding Co Llc

Inventors

• Dangi Salil
• Zarbock James
• Daza Ernest

Classifications

• G06N7/01 Primary

  Probabilistic graphical models, e.g. probabilistic networks · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F3/0641

  De-duplication techniques · CPC title

• G06F3/0608 Primary

  Saving storage space on storage systems · CPC title

• G06N7/005

  Physics · mapped topic