Cyclic redundancy check

Last updated

A cyclic redundancy check (CRC) is an error-detecting code commonly used in digital networks and storage devices to detect accidental changes to digital data. [1] [2] Blocks of data entering these systems get a short check value attached, based on the remainder of a polynomial division of their contents. On retrieval, the calculation is repeated and, in the event the check values do not match, corrective action can be taken against data corruption. CRCs can be used for error correction (see bitfilters). [3]

Contents

CRCs are so called because the check (data verification) value is a redundancy (it expands the message without adding information) and the algorithm is based on cyclic codes. CRCs are popular because they are simple to implement in binary hardware, easy to analyze mathematically, and particularly good at detecting common errors caused by noise in transmission channels. Because the check value has a fixed length, the function that generates it is occasionally used as a hash function.

Introduction

CRCs are based on the theory of cyclic error-correcting codes. The use of systematic cyclic codes, which encode messages by adding a fixed-length check value, for the purpose of error detection in communication networks, was first proposed by W. Wesley Peterson in 1961. [4] Cyclic codes are not only simple to implement but have the benefit of being particularly well suited for the detection of burst errors: contiguous sequences of erroneous data symbols in messages. This is important because burst errors are common transmission errors in many communication channels, including magnetic and optical storage devices. Typically an n-bit CRC applied to a data block of arbitrary length will detect any single error burst not longer than n bits, and the fraction of all longer error bursts that it will detect is approximately (1 − 2n).

Specification of a CRC code requires definition of a so-called generator polynomial. This polynomial becomes the divisor in a polynomial long division, which takes the message as the dividend and in which the quotient is discarded and the remainder becomes the result. The important caveat is that the polynomial coefficients are calculated according to the arithmetic of a finite field, so the addition operation can always be performed bitwise-parallel (there is no carry between digits).

In practice, all commonly used CRCs employ the finite field of two elements, GF(2). The two elements are usually called 0 and 1, comfortably matching computer architecture.

A CRC is called an n-bit CRC when its check value is n bits long. For a given n, multiple CRCs are possible, each with a different polynomial. Such a polynomial has highest degree n, which means it has n + 1 terms. In other words, the polynomial has a length of n + 1; its encoding requires n + 1 bits. Note that most polynomial specifications either drop the MSB or LSB, since they are always 1. The CRC and associated polynomial typically have a name of the form CRC-n-XXX as in the table below.

The simplest error-detection system, the parity bit, is in fact a 1-bit CRC: it uses the generator polynomial x + 1 (two terms), [5] and has the name CRC-1.

Application

A CRC-enabled device calculates a short, fixed-length binary sequence, known as the check value or CRC, for each block of data to be sent or stored and appends it to the data, forming a codeword.

When a codeword is received or read, the device either compares its check value with one freshly calculated from the data block, or equivalently, performs a CRC on the whole codeword and compares the resulting check value with an expected residue constant.

If the CRC values do not match, then the block contains a data error.

The device may take corrective action, such as rereading the block or requesting that it be sent again. Otherwise, the data is assumed to be error-free (though, with some small probability, it may contain undetected errors; this is inherent in the nature of error-checking). [6]

Data integrity

CRCs are specifically designed to protect against common types of errors on communication channels, where they can provide quick and reasonable assurance of the integrity of messages delivered. However, they are not suitable for protecting against intentional alteration of data.

Firstly, as there is no authentication, an attacker can edit a message and recompute the CRC without the substitution being detected. When stored alongside the data, CRCs and cryptographic hash functions by themselves do not protect against intentional modification of data. Any application that requires protection against such attacks must use cryptographic authentication mechanisms, such as message authentication codes or digital signatures (which are commonly based on cryptographic hash functions).

Secondly, unlike cryptographic hash functions, CRC is an easily reversible function, which makes it unsuitable for use in digital signatures. [7]

Thirdly, CRC satisfies a relation similar to that of a linear function (or more accurately, an affine function): [8]

where depends on the length of and . This can be also stated as follows, where , and have the same length

as a result, even if the CRC is encrypted with a stream cipher that uses XOR as its combining operation (or mode of block cipher which effectively turns it into a stream cipher, such as OFB or CFB), both the message and the associated CRC can be manipulated without knowledge of the encryption key; this was one of the well-known design flaws of the Wired Equivalent Privacy (WEP) protocol. [9]

Computation

To compute an n-bit binary CRC, line the bits representing the input in a row, and position the (n + 1)-bit pattern representing the CRC's divisor (called a "polynomial") underneath the left end of the row.

In this example, we shall encode 14 bits of message with a 3-bit CRC, with a polynomial x3 + x + 1. The polynomial is written in binary as the coefficients; a 3rd-degree polynomial has 4 coefficients (1x3 + 0x2 + 1x + 1). In this case, the coefficients are 1, 0, 1 and 1. The result of the calculation is 3 bits long, which is why it is called a 3-bit CRC. However, you need 4 bits to explicitly state the polynomial.

Start with the message to be encoded:

11010011101100 

This is first padded with zeros corresponding to the bit length n of the CRC. This is done so that the resulting code word is in systematic form. Here is the first calculation for computing a 3-bit CRC:

11010011101100 000 <--- input right padded by 3 bits 1011               <--- divisor (4 bits) = x³ + x + 1 ------------------ 01100011101100 000 <--- result 

The algorithm acts on the bits directly above the divisor in each step. The result for that iteration is the bitwise XOR of the polynomial divisor with the bits above it. The bits not above the divisor are simply copied directly below for that step. The divisor is then shifted right to align with the highest remaining 1 bit in the input, and the process is repeated until the divisor reaches the right-hand end of the input row. Here is the entire calculation:

11010011101100 000 <--- input right padded by 3 bits 1011               <--- divisor 01100011101100 000 <--- result (note the first four bits are the XOR with the divisor beneath, the rest of the bits are unchanged)  1011              <--- divisor ... 00111011101100 000   1011 00010111101100 000    1011 00000001101100 000 <--- note that the divisor moves over to align with the next 1 in the dividend (since quotient for that step was zero)        1011             (in other words, it doesn't necessarily move one bit per iteration) 00000000110100 000         1011 00000000011000 000          1011 00000000001110 000           1011 00000000000101 000            101 1 ----------------- 00000000000000 100 <--- remainder (3 bits).  Division algorithm stops here as dividend is equal to zero. 

Since the leftmost divisor bit zeroed every input bit it touched, when this process ends the only bits in the input row that can be nonzero are the n bits at the right-hand end of the row. These n bits are the remainder of the division step, and will also be the value of the CRC function (unless the chosen CRC specification calls for some postprocessing).

The validity of a received message can easily be verified by performing the above calculation again, this time with the check value added instead of zeroes. The remainder should equal zero if there are no detectable errors.

11010011101100 100 <--- input with check value 1011               <--- divisor 01100011101100 100 <--- result  1011              <--- divisor ... 00111011101100 100  ......  00000000001110 100           1011 00000000000101 100            101 1 ------------------ 00000000000000 000 <--- remainder 

The following Python code outlines a function which will return the initial CRC remainder for a chosen input and polynomial, with either 1 or 0 as the initial padding. Note that this code works with string inputs rather than raw numbers:

defcrc_remainder(input_bitstring,polynomial_bitstring,initial_filler):"""Calculate the CRC remainder of a string of bits using a chosen polynomial.    initial_filler should be '1' or '0'.    """polynomial_bitstring=polynomial_bitstring.lstrip('0')len_input=len(input_bitstring)initial_padding=(len(polynomial_bitstring)-1)*initial_fillerinput_padded_array=list(input_bitstring+initial_padding)while'1'ininput_padded_array[:len_input]:cur_shift=input_padded_array.index('1')foriinrange(len(polynomial_bitstring)):input_padded_array[cur_shift+i] \             =str(int(polynomial_bitstring[i]!=input_padded_array[cur_shift+i]))return''.join(input_padded_array)[len_input:]defcrc_check(input_bitstring,polynomial_bitstring,check_value):"""Calculate the CRC check of a string of bits using a chosen polynomial."""polynomial_bitstring=polynomial_bitstring.lstrip('0')len_input=len(input_bitstring)initial_padding=check_valueinput_padded_array=list(input_bitstring+initial_padding)while'1'ininput_padded_array[:len_input]:cur_shift=input_padded_array.index('1')foriinrange(len(polynomial_bitstring)):input_padded_array[cur_shift+i] \             =str(int(polynomial_bitstring[i]!=input_padded_array[cur_shift+i]))return('1'notin''.join(input_padded_array)[len_input:])
>>> crc_remainder('11010011101100','1011','0')'100'>>> crc_check('11010011101100','1011','100')True

Mathematics

Mathematical analysis of this division-like process reveals how to select a divisor that guarantees good error-detection properties. In this analysis, the digits of the bit strings are taken as the coefficients of a polynomial in some variable x—coefficients that are elements of the finite field GF(2) (the integers modulo 2, i.e. either a zero or a one), instead of more familiar numbers. The set of binary polynomials is a mathematical ring.

Designing polynomials

The selection of the generator polynomial is the most important part of implementing the CRC algorithm. The polynomial must be chosen to maximize the error-detecting capabilities while minimizing overall collision probabilities.

The most important attribute of the polynomial is its length (largest degree(exponent) +1 of any one term in the polynomial), because of its direct influence on the length of the computed check value.

The most commonly used polynomial lengths are 9 bits (CRC-8), 17 bits (CRC-16), 33 bits (CRC-32), and 65 bits (CRC-64). [5]

A CRC is called an n-bit CRC when its check value is n-bits. For a given n, multiple CRCs are possible, each with a different polynomial. Such a polynomial has highest degree n, and hence n + 1 terms (the polynomial has a length of n + 1). The remainder has length n. The CRC has a name of the form CRC-n-XXX.

The design of the CRC polynomial depends on the maximum total length of the block to be protected (data + CRC bits), the desired error protection features, and the type of resources for implementing the CRC, as well as the desired performance. A common misconception is that the "best" CRC polynomials are derived from either irreducible polynomials or irreducible polynomials times the factor 1 + x, which adds to the code the ability to detect all errors affecting an odd number of bits. [10] In reality, all the factors described above should enter into the selection of the polynomial and may lead to a reducible polynomial. However, choosing a reducible polynomial will result in a certain proportion of missed errors, due to the quotient ring having zero divisors.

The advantage of choosing a primitive polynomial as the generator for a CRC code is that the resulting code has maximal total block length in the sense that all 1-bit errors within that block length have different remainders (also called syndromes) and therefore, since the remainder is a linear function of the block, the code can detect all 2-bit errors within that block length. If is the degree of the primitive generator polynomial, then the maximal total block length is , and the associated code is able to detect any single-bit or double-bit errors. [11] We can improve this situation. If we use the generator polynomial , where is a primitive polynomial of degree , then the maximal total block length is , and the code is able to detect single, double, triple and any odd number of errors.

A polynomial that admits other factorizations may be chosen then so as to balance the maximal total blocklength with a desired error detection power. The BCH codes are a powerful class of such polynomials. They subsume the two examples above. Regardless of the reducibility properties of a generator polynomial of degree r, if it includes the "+1" term, the code will be able to detect error patterns that are confined to a window of r contiguous bits. These patterns are called "error bursts".

Specification

The concept of the CRC as an error-detecting code gets complicated when an implementer or standards committee uses it to design a practical system. Here are some of the complications:

These complications mean that there are three common ways to express a polynomial as an integer: the first two, which are mirror images in binary, are the constants found in code; the third is the number found in Koopman's papers. In each case, one term is omitted. So the polynomial may be transcribed as:

In the table below they are shown as:

Examples of CRC representations
NameNormalReversedReversed reciprocal
CRC-40x30xC0x9

Obfuscation

CRCs in proprietary protocols might be obfuscated by using a non-trivial initial value and a final XOR, but these techniques do not add cryptographic strength to the algorithm and can be reverse engineered using straightforward methods. [12]

Standards and common use

Numerous varieties of cyclic redundancy checks have been incorporated into technical standards. By no means does one algorithm, or one of each degree, suit every purpose; Koopman and Chakravarty recommend selecting a polynomial according to the application requirements and the expected distribution of message lengths. [13] The number of distinct CRCs in use has confused developers, a situation which authors have sought to address. [10] There are three polynomials reported for CRC-12, [13] twenty-two conflicting definitions of CRC-16, and seven of CRC-32. [14]

The polynomials commonly applied are not the most efficient ones possible. Since 1993, Koopman, Castagnoli and others have surveyed the space of polynomials between 3 and 64 bits in size, [13] [15] [16] [17] finding examples that have much better performance (in terms of Hamming distance for a given message size) than the polynomials of earlier protocols, and publishing the best of these with the aim of improving the error detection capacity of future standards. [16] In particular, iSCSI and SCTP have adopted one of the findings of this research, the CRC-32C (Castagnoli) polynomial.

The design of the 32-bit polynomial most commonly used by standards bodies, CRC-32-IEEE, was the result of a joint effort for the Rome Laboratory and the Air Force Electronic Systems Division by Joseph Hammond, James Brown and Shyan-Shiang Liu of the Georgia Institute of Technology and Kenneth Brayer of the Mitre Corporation. The earliest known appearances of the 32-bit polynomial were in their 1975 publications: Technical Report 2956 by Brayer for Mitre, published in January and released for public dissemination through DTIC in August, [18] and Hammond, Brown and Liu's report for the Rome Laboratory, published in May. [19] Both reports contained contributions from the other team. During December 1975, Brayer and Hammond presented their work in a paper at the IEEE National Telecommunications Conference: the IEEE CRC-32 polynomial is the generating polynomial of a Hamming code and was selected for its error detection performance. [20] Even so, the Castagnoli CRC-32C polynomial used in iSCSI or SCTP matches its performance on messages from 58 bits to 131 kbits, and outperforms it in several size ranges including the two most common sizes of Internet packet. [16] The ITU-T G.hn standard also uses CRC-32C to detect errors in the payload (although it uses CRC-16-CCITT for PHY headers).

CRC-32C computation is implemented in hardware as an operation (CRC32) of SSE4.2 instruction set, first introduced in Intel processors' Nehalem microarchitecture. ARM AArch64 architecture also provides hardware acceleration for both CRC-32 and CRC-32C operations.

Polynomial representations

The table below lists only the polynomials of the various algorithms in use. Variations of a particular protocol can impose pre-inversion, post-inversion and reversed bit ordering as described above. For example, the CRC32 used in Gzip and Bzip2 use the same polynomial, but Gzip employs reversed bit ordering, while Bzip2 does not. [14] Note that even parity polynomials in GF(2) with degree greater than 1 are never primitive. Even parity polynomial marked as primitive in this table represent a primitive polynomial multiplied by . The most significant bit of a polynomial is always 1, and is not shown in the hex representations.

NameUses Polynomial representations Parity [21] Primitive [22] Maximum bits of payload by Hamming distance [23] [16] [22]
Normal Reversed Reciprocal Reversed reciprocal 1615141312111098765432 [24]
CRC-1most hardware; also known as parity bit 0x10x10x10x1even
CRC-3-GSM mobile networks [25] 0x30x60x50x5oddyes [26] 4
CRC-4-ITU ITU-T G.704, p. 120x30xC0x90x9odd
CRC-5-EPC Gen 2 RFID [27] 0x090x120x050x14odd
CRC-5-ITUITU-T G.704, p. 90x150x150x0B0x1Aeven
CRC-5-USB USB token packets0x050x140x090x12odd
CRC-6-CDMA2000-Amobile networks [28] 0x270x390x330x33odd
CRC-6-CDMA2000-Bmobile networks [28] 0x070x380x310x23even
CRC-6-DARC Data Radio Channel [29] 0x190x260x0D0x2Ceven
CRC-6-GSM mobile networks [25] 0x2F0x3D0x3B0x37evenyes [30] 112525
CRC-6-ITUITU-T G.704, p. 30x030x300x210x21odd
CRC-7telecom systems, ITU-T G.707, ITU-T G.832, MMC, SD 0x090x480x110x44odd
CRC-7-MVB Train Communication Network, IEC 60870-5 [31] 0x650x530x270x72odd
CRC-8 DVB-S2 [32] 0xD50xAB0x570xEA [13] evenno [33] 228585
CRC-8-AUTOSAR automotive integration, [34] OpenSafety [35] 0x2F0xF40xE90x97 [13] evenyes [33] 33119119
CRC-8-Bluetooth wireless connectivity [36] 0xA70xE50xCB0xD3even
CRC-8-CCITT ITU-T I.432.1 (02/99); ATM HEC, ISDN HEC and cell delineation, SMBus PEC 0x070xE00xC10x83even
CRC-8-Dallas/Maxim 1-Wire bus [37] 0x310x8C0x190x98even
CRC-8-DARC Data Radio Channel [29] 0x390x9C0x390x9Codd
CRC-8-GSM-Bmobile networks [25] 0x490x920x250xA4even
CRC-8-SAE J1850 AES3; OBD 0x1D0xB80x710x8Eodd
CRC-8-WCDMA mobile networks [28] [38] 0x9B0xD90xB30xCD [13] even
CRC-10ATM; ITU-T I.610 0x2330x3310x2630x319even
CRC-10-CDMA2000 mobile networks [28] 0x3D90x26F0x0DF0x3ECeven
CRC-10-GSM mobile networks [25] 0x1750x2BA0x1750x2BAodd
CRC-11 FlexRay [39] 0x3850x50E0x21D0x5C2even
CRC-12telecom systems [40] [41] 0x80F0xF010xE030xC07 [13] even
CRC-12-CDMA2000 mobile networks [28] 0xF130xC8F0x91F0xF89even
CRC-12-GSM mobile networks [25] 0xD310x8CB0x1970xE98odd
CRC-13-BBCTime signal, Radio teleswitch [42] [43] 0x1CF50x15E70x0BCF0x1E7Aeven
CRC-14-DARC Data Radio Channel [29] 0x08050x28040x10090x2402even
CRC-14-GSM mobile networks [25] 0x202D0x2D010x1A030x3016even
CRC-15-CAN 0xC599 [44] [45] 0x4CD10x19A30x62CCeven
CRC-15-MPT1327 [46] 0x68150x540B0x28170x740Aodd
CRC-16-ChakravartyOptimal for payloads ≤64 bits [31] 0x2F150xA8F40x51E90x978Aodd
CRC-16-ARINC ACARS applications [47] 0xA02B0xD4050xA80B0xD015odd
CRC-16-CCITT X.25, V.41, HDLC FCS, XMODEM, Bluetooth, PACTOR, SD, DigRF, many others; known as CRC-CCITT0x10210x84080x8110x8810 [13] even
CRC-16-CDMA2000 mobile networks [28] 0xC8670xE6130xCC270xE433odd
CRC-16-DECT cordless telephones [48] 0x05890x91A00x23410x82C4even
CRC-16-T10-DIF SCSI DIF0x8BB7 [49] 0xEDD10xDBA30xC5DBodd
CRC-16-DNP DNP, IEC 870, M-Bus 0x3D650xA6BC0x4D790x9EB2even
CRC-16-IBM Bisync, Modbus, USB, ANSI X3.28, SIA DC-07, many others; also known as CRC-16 and CRC-16-ANSI0x80050xA0010x40030xC002even
CRC-16-OpenSafety-Asafety fieldbus [35] 0x59350xAC9A0x59350xAC9A [13] odd
CRC-16-OpenSafety-Bsafety fieldbus [35] 0x755B0xDAAE0xB55D0xBAAD [13] odd
CRC-16-Profibus fieldbus networks [50] 0x1DCF0xF3B80xE7710x8EE7odd
Fletcher-16Used in Adler-32 A & B ChecksumsOften confused to be a CRC, but actually a checksum; see Fletcher's checksum
CRC-17-CANCAN FD [51] 0x1685B0x1B42D0x1685B0x1B42Deven
CRC-21-CANCAN FD [51] 0x1028990x1322810x0645030x18144Ceven
CRC-24 FlexRay [39] 0x5D6DCB0xD3B6BA0xA76D750xAEB6E5even
CRC-24-Radix-64 OpenPGP, RTCM104v30x864CFB0xDF32610xBE64C30xC3267Deven
CRC-24-WCDMA Used in OS-9 RTOS. Residue = 0x800FE3. [52] 0x8000630xC600010x8C00030xC00031evenyes [53] 4483885838388583
CRC-30 CDMA 0x2030B9C70x38E743010x31CE86030x30185CE3even
CRC-32 ISO 3309 (HDLC), ANSI X3.66 (ADCCP), FIPS PUB 71, FED-STD-1003, ITU-T V.42, ISO/IEC/IEEE 802-3 (Ethernet), SATA, MPEG-2, PKZIP, Gzip, Bzip2, POSIX cksum, [54] PNG, [55] ZMODEM, many others0x04C11DB70xEDB883200xDB7106410x82608EDB [16] oddyes1012213457911712682974916074294967263
CRC-32C (Castagnoli) iSCSI, SCTP, G.hn payload, SSE4.2, Btrfs, ext4, Ceph 0x1EDC6F410x82F63B780x05EC76F10x8F6E37A0 [16] evenyes68204717752432147483615
CRC-32K (Koopman {1,3,28})Excellent at Ethernet frame length, poor performance with long files [ citation needed ]0x741B8CD70xEB31D82E0xD663B05D0xBA0DC66B [16] evenno24161815216360114663
CRC-32K2 (Koopman {1,1,30})Excellent at Ethernet frame length, poor performance with long files [ citation needed ]0x325834990x992C1A4C0x325834990x992C1A4C [16] evenno316261343273865506
CRC-32Qaviation; AIXM [56] 0x814141AB0xD58282810xAB0505030xC0A0A0D5even
Adler-32Often confused to be a CRC, but actually a checksum; see Adler-32
CRC-40-GSM GSM control channel [57] [58] [59] 0x00048200090x90004120000x20008240010x8002410004even
CRC-64-ECMA ECMA-182 p. 51, XZ Utils 0x42F0E1EBA9EA36930xC96C5795D7870F420x92D8AF2BAF0E1E850xA17870F5D4F51B49even
CRC-64-ISOISO 3309 (HDLC), Swiss-Prot/TrEMBL; considered weak for hashing [60] 0x000000000000001B0xD8000000000000000xB0000000000000010x800000000000000Dodd

Implementations

CRC catalogues

See also

Related Research Articles

<span class="mw-page-title-main">Checksum</span> Data used to detect errors in other data

A checksum is a small-sized block of data derived from another block of digital data for the purpose of detecting errors that may have been introduced during its transmission or storage. By themselves, checksums are often used to verify data integrity but are not relied upon to verify data authenticity.

<span class="mw-page-title-main">Error detection and correction</span> Techniques that enable reliable delivery of digital data over unreliable communication channels

In information theory and coding theory with applications in computer science and telecommunication, error detection and correction (EDAC) or error control are techniques that enable reliable delivery of digital data over unreliable communication channels. Many communication channels are subject to channel noise, and thus errors may be introduced during transmission from the source to a receiver. Error detection techniques allow detecting such errors, while error correction enables reconstruction of the original data in many cases.

<span class="mw-page-title-main">Hash function</span> Mapping arbitrary data to fixed-size values

A hash function is any function that can be used to map data of arbitrary size to fixed-size values, though there are some hash functions that support variable length output. The values returned by a hash function are called hash values, hash codes, hash digests, digests, or simply hashes. The values are usually used to index a fixed-size table called a hash table. Use of a hash function to index a hash table is called hashing or scatter storage addressing.

In coding theory, the Bose–Chaudhuri–Hocquenghem codes form a class of cyclic error-correcting codes that are constructed using polynomials over a finite field. BCH codes were invented in 1959 by French mathematician Alexis Hocquenghem, and independently in 1960 by Raj Chandra Bose and D.K. Ray-Chaudhuri. The name Bose–Chaudhuri–Hocquenghem arises from the initials of the inventors' surnames.

<span class="mw-page-title-main">Hamming code</span> Family of linear error-correcting codes

In computer science and telecommunication, Hamming codes are a family of linear error-correcting codes. Hamming codes can detect one-bit and two-bit errors, or correct one-bit errors without detection of uncorrected errors. By contrast, the simple parity code cannot correct errors, and can detect only an odd number of bits in error. Hamming codes are perfect codes, that is, they achieve the highest possible rate for codes with their block length and minimum distance of three. Richard W. Hamming invented Hamming codes in 1950 as a way of automatically correcting errors introduced by punched card readers. In his original paper, Hamming elaborated his general idea, but specifically focused on the Hamming(7,4) code which adds three parity bits to four bits of data.

In telecommunication, a longitudinal redundancy check (LRC), or horizontal redundancy check, is a form of redundancy check that is applied independently to each of a parallel group of bit streams. The data must be divided into transmission blocks, to which the additional check data is added.

Reed–Solomon codes are a group of error-correcting codes that were introduced by Irving S. Reed and Gustave Solomon in 1960. They have many applications, including consumer technologies such as MiniDiscs, CDs, DVDs, Blu-ray discs, QR codes, Data Matrix, data transmission technologies such as DSL and WiMAX, broadcast systems such as satellite communications, DVB and ATSC, and storage systems such as RAID 6.

In computing, a linear-feedback shift register (LFSR) is a shift register whose input bit is a linear function of its previous state.

A parity bit, or check bit, is a bit added to a string of binary code. Parity bits are a simple form of error detecting code. Parity bits are generally applied to the smallest units of a communication protocol, typically 8-bit octets (bytes), although they can also be applied separately to an entire message string of bits.

<span class="mw-page-title-main">Coding theory</span> Study of the properties of codes and their fitness

Coding theory is the study of the properties of codes and their respective fitness for specific applications. Codes are used for data compression, cryptography, error detection and correction, data transmission and data storage. Codes are studied by various scientific disciplines—such as information theory, electrical engineering, mathematics, linguistics, and computer science—for the purpose of designing efficient and reliable data transmission methods. This typically involves the removal of redundancy and the correction or detection of errors in the transmitted data.

In finite field theory, a branch of mathematics, a primitive polynomial is the minimal polynomial of a primitive element of the finite field GF(pm). This means that a polynomial F(X) of degree m with coefficients in GF(p) = Z/pZ is a primitive polynomial if it is monic and has a root α in GF(pm) such that is the entire field GF(pm). This implies that α is a primitive (pm − 1)-root of unity in GF(pm).

A frame check sequence (FCS) is an error-detecting code added to a frame in a communication protocol. Frames are used to send payload data from a source to a destination.

CRC-based framing is a kind of frame synchronization used in Asynchronous Transfer Mode (ATM) and other similar protocols.

In computing, telecommunication, information theory, and coding theory, forward error correction (FEC) or channel coding is a technique used for controlling errors in data transmission over unreliable or noisy communication channels.

The cyclic redundancy check (CRC) is based on division in the ring of polynomials over the finite field GF(2), that is, the set of polynomials where each coefficient is either zero or one, and arithmetic operations wrap around.

<span class="mw-page-title-main">Computation of cyclic redundancy checks</span> Overview of the computation of cyclic redundancy checks

Computation of a cyclic redundancy check is derived from the mathematics of polynomial division, modulo two. In practice, it resembles long division of the binary message string, with a fixed number of zeroes appended, by the "generator polynomial" string except that exclusive or operations replace subtractions. Division of this type is efficiently realised in hardware by a modified shift register, and in software by a series of equivalent algorithms, starting with simple code close to the mathematics and becoming faster through byte-wise parallelism and space–time tradeoffs.

In coding theory, a polynomial code is a type of linear code whose set of valid code words consists of those polynomials that are divisible by a given fixed polynomial.

Multiscale Electrophysiology Format (MEF) was developed to handle the large amounts of data produced by large-scale electrophysiology in human and animal subjects. MEF can store any time series data up to 24 bits in length, and employs lossless range encoded difference compression. Subject identifying information in the file header can be encrypted using 128-bit AES encryption in order to comply with HIPAA requirements for patient privacy when transmitting data across an open network.

A locally decodable code (LDC) is an error-correcting code that allows a single bit of the original message to be decoded with high probability by only examining a small number of bits of a possibly corrupted codeword. This property could be useful, say, in a context where information is being transmitted over a noisy channel, and only a small subset of the data is required at a particular time and there is no need to decode the entire message at once. Note that locally decodable codes are not a subset of locally testable codes, though there is some overlap between the two.

In coding theory, burst error-correcting codes employ methods of correcting burst errors, which are errors that occur in many consecutive bits rather than occurring in bits independently of each other.

References

  1. Pundir, Meena; Sandhu, Jasminder Kaur (2021). "A Systematic Review of Quality of Service in Wireless Sensor Networks using Machine Learning: Recent Trend and Future Vision". Journal of Network and Computer Applications. 188: 103084. doi:10.1016/j.jnca.2021.103084. Cyclic Redundancy Check (CRC) mechanism is used to protect the data and provide protection of integrity from error bits when data is transmitted from sender to receiver.
  2. Schiller, Frank; Mattes, Tina (2007). "Analysis of CRC-Polynomials for Safety-Critical Communication by Deterministic and Stochastic Automata". Fault Detection, Supervision and Safety of Technical Processes 2006. Elsevier. p. 944–949. doi:10.1016/b978-008044485-7/50159-7. ISBN   978-0-08-044485-7. Cyclic Redundancy Check (CRC) is an efficient method to ensure a low probability of undetected errors in data transmission using a checksum as a result of polynomial division.
  3. "An Algorithm for Error Correcting Cyclic Redundance Checks". drdobbs.com. Archived from the original on 20 July 2017. Retrieved 28 June 2017.
  4. Peterson, W. W.; Brown, D. T. (January 1961). "Cyclic Codes for Error Detection". Proceedings of the IRE. 49 (1): 228–235. doi:10.1109/JRPROC.1961.287814. S2CID   51666741.
  5. 1 2 Ergen, Mustafa (21 January 2008). "2.3.3 Error Detection Coding". Mobile Broadband. Springer. pp. 29–30. doi:10.1007/978-0-387-68192-4_2. ISBN   978-0-387-68192-4.
  6. Ritter, Terry (February 1986). "The Great CRC Mystery". Dr. Dobb's Journal . 11 (2): 26–34, 76–83. Archived from the original on 16 April 2009. Retrieved 21 May 2009.
  7. Stigge, Martin; Plötz, Henryk; Müller, Wolf; Redlich, Jens-Peter (May 2006). "Reversing CRC – Theory and Practice" (PDF). Humboldt University Berlin. p. 17. SAR-PR-2006-05. Archived from the original (PDF) on 19 July 2011. Retrieved 4 February 2011. The presented methods offer a very easy and efficient way to modify your data so that it will compute to a CRC you want or at least know in advance.
  8. "algorithm design – Why is CRC said to be linear?". Cryptography Stack Exchange. Retrieved 5 May 2019.
  9. Cam-Winget, Nancy; Housley, Russ; Wagner, David; Walker, Jesse (May 2003). "Security Flaws in 802.11 Data Link Protocols" (PDF). Communications of the ACM. 46 (5): 35–39. CiteSeerX   10.1.1.14.8775 . doi:10.1145/769800.769823. S2CID   3132937. Archived (PDF) from the original on 26 May 2013. Retrieved 1 November 2017.
  10. 1 2 3 Williams, Ross N. (24 September 1996). "A Painless Guide to CRC Error Detection Algorithms V3.0". Archived from the original on 2 April 2018. Retrieved 23 May 2019.
  11. Press, WH; Teukolsky, SA; Vetterling, WT; Flannery, BP (2007). "Section 22.4 Cyclic Redundancy and Other Checksums". Numerical Recipes: The Art of Scientific Computing (3rd ed.). Cambridge University Press. ISBN   978-0-521-88068-8. Archived from the original on 11 August 2011. Retrieved 18 August 2011.
  12. Ewing, Gregory C. (March 2010). "Reverse-Engineering a CRC Algorithm". Christchurch: University of Canterbury. Archived from the original on 7 August 2011. Retrieved 26 July 2011.
  13. 1 2 3 4 5 6 7 8 9 10 Koopman, Philip; Chakravarty, Tridib (June 2004). "Cyclic redundancy code (CRC) polynomial selection for embedded networks". International Conference on Dependable Systems and Networks, 2004 (PDF). pp. 145–154. CiteSeerX   10.1.1.648.9080 . doi:10.1109/DSN.2004.1311885. ISBN   978-0-7695-2052-0. S2CID   793862. Archived (PDF) from the original on 11 September 2011. Retrieved 14 January 2011.
  14. 1 2 Cook, Greg (15 August 2020). "Catalogue of parametrised CRC algorithms". Archived from the original on 1 August 2020. Retrieved 18 September 2020.
  15. Castagnoli, G.; Bräuer, S.; Herrmann, M. (June 1993). "Optimization of Cyclic Redundancy-Check Codes with 24 and 32 Parity Bits". IEEE Transactions on Communications. 41 (6): 883–892. doi:10.1109/26.231911.
  16. 1 2 3 4 5 6 7 8 Koopman, Philip (July 2002). "32-bit cyclic redundancy codes for Internet applications". Proceedings International Conference on Dependable Systems and Networks (PDF). pp. 459–468. CiteSeerX   10.1.1.11.8323 . doi:10.1109/DSN.2002.1028931. ISBN   978-0-7695-1597-7. S2CID   14775606. Archived (PDF) from the original on 16 September 2012. Retrieved 14 January 2011.
  17. Koopman, Philip (21 January 2016). "Best CRC Polynomials". Carnegie Mellon University. Archived from the original on 20 January 2016. Retrieved 26 January 2016.
  18. Brayer, Kenneth (August 1975). Evaluation of 32 Degree Polynomials in Error Detection on the SATIN IV Autovon Error Patterns (Report). National Technical Information Service. ADA014825. Archived from the original on 31 December 2021. Retrieved 31 December 2021.
  19. Hammond, Joseph L. Jr.; Brown, James E.; Liu, Shyan-Shiang (1975). "Development of a Transmission Error Model and an Error Control Model". NASA Sti/Recon Technical Report N. 76 (published May 1975): 15344. Bibcode:1975STIN...7615344H. ADA013939. Archived from the original on 31 December 2021. Retrieved 31 December 2021.
  20. Brayer, Kenneth; Hammond, Joseph L. Jr. (December 1975). Evaluation of error detection polynomial performance on the AUTOVON channel. NTC 75 : National Telecommunications Conference, December 1–3, 1975, New Orleans, Louisiana. Vol. 1. Institute of Electrical and Electronics Engineers. pp. 8–21–5. Bibcode:1975ntc.....1....8B. OCLC   32688603. 75 CH 1015-7 CSCB.
  21. CRCs with even parity detect any odd number of bit errors, at the expense of lower hamming distance for long payloads. Note that parity is computed over the entire generator polynomial, including implied 1 at the beginning or the end. For example, the full representation of CRC-1 is 0x3, which has two 1 bits. Thus, its parity is even.
  22. 1 2 "32 Bit CRC Zoo". users.ece.cmu.edu. Archived from the original on 19 March 2018. Retrieved 5 November 2017.
  23. Payload means length exclusive of CRC field. A Hamming distance of d means that d  1 bit errors can be detected and ⌊(d  1)/2⌋ bit errors can be corrected
  24. is always achieved for arbitrarily long messages
  25. 1 2 3 4 5 6 ETSI TS 100 909 (PDF). V8.9.0. Sophia Antipolis, France: European Telecommunications Standards Institute. January 2005. Archived (PDF) from the original on 17 April 2018. Retrieved 21 October 2016.
  26. "3 Bit CRC Zoo". users.ece.cmu.edu. Archived from the original on 7 April 2018. Retrieved 19 January 2018.
  27. Class-1 Generation-2 UHF RFID Protocol (PDF). 1.2.0. EPCglobal. 23 October 2008. p. 35. Archived (PDF) from the original on 19 March 2012. Retrieved 4 July 2012. (Table 6.12)
  28. 1 2 3 4 5 6 Physical layer standard for cdma2000 spread spectrum systems (PDF). Revision D version 2.0. 3rd Generation Partnership Project 2. October 2005. pp. 2–89–2–92. Archived from the original (PDF) on 16 November 2013. Retrieved 14 October 2013.
  29. 1 2 3 "11. Error correction strategy". ETSI EN 300 751 (PDF). V1.2.1. Sophia Antipolis, France: European Telecommunications Standards Institute. January 2003. pp. 67–8. Archived (PDF) from the original on 28 December 2015. Retrieved 26 January 2016.
  30. "6 Bit CRC Zoo". users.ece.cmu.edu. Archived from the original on 7 April 2018. Retrieved 19 January 2018.
  31. 1 2 Chakravarty, Tridib (December 2001). Performance of Cyclic Redundancy Codes for Embedded Networks (PDF) (Thesis). Philip Koopman, advisor. Carnegie Mellon University. pp. 5, 18. Archived (PDF) from the original on 1 January 2014. Retrieved 8 July 2013.
  32. "5.1.4 CRC-8 encoder (for packetized streams only)". EN 302 307 (PDF). V1.3.1. Sophia Antipolis, France: European Telecommunications Standards Institute. March 2013. p. 17. Archived (PDF) from the original on 30 August 2017. Retrieved 29 July 2016.
  33. 1 2 "8 Bit CRC Zoo". users.ece.cmu.edu. Archived from the original on 7 April 2018. Retrieved 19 January 2018.
  34. "7.2.1.2 8-bit 0x2F polynomial CRC Calculation". Specification of CRC Routines (PDF). 4.2.2. Munich: AUTOSAR. 22 July 2015. p. 24. Archived from the original (PDF) on 24 July 2016. Retrieved 24 July 2016.
  35. 1 2 3 "5.1.1.8 Cyclic Redundancy Check field (CRC-8 / CRC-16)". openSAFETY Safety Profile Specification: EPSG Working Draft Proposal 304. 1.4.0. Berlin: Ethernet POWERLINK Standardisation Group. 13 March 2013. p. 42. Archived from the original on 12 August 2017. Retrieved 22 July 2016.
  36. "B.7.1.1 HEC generation". Specification of the Bluetooth System. Vol. 2. Bluetooth SIG. 2 December 2014. pp. 144–5. Archived from the original on 26 March 2015. Retrieved 20 October 2014.
  37. Whitfield, Harry (24 April 2001). "XFCNs for Cyclic Redundancy Check Calculations". Archived from the original on 25 May 2005.
  38. Richardson, Andrew (17 March 2005). WCDMA Handbook. Cambridge University Press. p. 223. ISBN   978-0-521-82815-4.
  39. 1 2 FlexRay Protocol Specification. 3.0.1. Flexray Consortium. October 2010. p. 114. (4.2.8 Header CRC (11 bits))
  40. Perez, A. (1983). "Byte-Wise CRC Calculations". IEEE Micro. 3 (3): 40–50. doi:10.1109/MM.1983.291120. S2CID   206471618.
  41. Ramabadran, T.V.; Gaitonde, S.S. (1988). "A tutorial on CRC computations". IEEE Micro. 8 (4): 62–75. doi:10.1109/40.7773. S2CID   10216862.
  42. "Longwave Radio Data Decoding using and HC11 and an MC3371" (PDF). Freescale Semiconductor. 2004. AN1597/D. Archived from the original (PDF) on 24 September 2015.
  43. Ely, S.R.; Wright, D.T. (March 1982). L.F. Radio-Data: specification of BBC experimental transmissions 1982 (PDF). Research Department, Engineering Division, The British Broadcasting Corporation. p. 9. Archived (PDF) from the original on 12 October 2013. Retrieved 11 October 2013.
  44. Cyclic Redundancy Check (CRC): PSoC Creator™ Component Datasheet. Cypress Semiconductor. 20 February 2013. p. 4. Archived from the original on 2 February 2016. Retrieved 26 January 2016.
  45. "Cyclic redundancy check (CRC) in CAN frames". CAN in Automation. Archived from the original on 1 February 2016. Retrieved 26 January 2016.
  46. "3.2.3 Encoding and error checking". A signalling standard for trunked private land mobile radio systems (MPT 1327) (PDF) (3rd ed.). Ofcom. June 1997. p. 3. Archived (PDF) from the original on 14 July 2012. Retrieved 16 July 2012.
  47. Rehmann, Albert; Mestre, José D. (February 1995). "Air Ground Data Link VHF Airline Communications and Reporting System (ACARS) Preliminary Test Report" (PDF). Federal Aviation Authority Technical Center. p. 5. Archived from the original (PDF) on 2 August 2012. Retrieved 7 July 2012.
  48. "6.2.5 Error control". ETSI EN 300 175-3 (PDF). V2.5.1. Sophia Antipolis, France: European Telecommunications Standards Institute. August 2013. pp. 99, 101. Archived (PDF) from the original on 1 July 2015. Retrieved 26 January 2016.
  49. Thaler, Pat (28 August 2003). "16-bit CRC polynomial selection" (PDF). INCITS T10. Archived (PDF) from the original on 28 July 2011. Retrieved 11 August 2009.
  50. "8.8.4 Check Octet (FCS)". PROFIBUS Specification Normative Parts (PDF). 1.0. Vol. 9. Profibus International. March 1998. p. 906. Archived from the original (PDF) on 16 November 2008. Retrieved 9 July 2016.
  51. 1 2 CAN with Flexible Data-Rate Specification (PDF). 1.0. Robert Bosch GmbH. 17 April 2012. p. 13. Archived from the original (PDF) on 22 August 2013. (3.2.1 DATA FRAME)
  52. "OS-9 Operating System System Programmer's Manual". roug.org. Archived from the original on 17 July 2018. Retrieved 17 July 2018.
  53. Koopman, Philip P. (20 May 2018). "24 Bit CRC Zoo". users.ece.cmu.edu. Archived from the original on 7 April 2018. Retrieved 19 January 2018.
  54. "cksum". pubs.opengroup.org. Archived from the original on 18 July 2018. Retrieved 27 June 2017.
  55. Boutell, Thomas; Randers-Pehrson, Glenn; et al. (14 July 1998). "PNG (Portable Network Graphics) Specification, Version 1.2". Libpng.org. Archived from the original on 3 September 2011. Retrieved 3 February 2011.
  56. AIXM Primer (PDF). 4.5. European Organisation for the Safety of Air Navigation. 20 March 2006. Archived (PDF) from the original on 20 November 2018. Retrieved 3 February 2019.
  57. ETSI TS 100 909 Archived 17 April 2018 at the Wayback Machine version 8.9.0 (January 2005), Section 4.1.2 a
  58. Gammel, Berndt M. (31 October 2005). Matpack documentation: Crypto – Codes. Matpack.de. Archived from the original on 25 August 2013. Retrieved 21 April 2013. (Note: MpCRC.html is included with the Matpack compressed software source code, under /html/LibDoc/Crypto)
  59. Geremia, Patrick (April 1999). "Cyclic redundancy check computation: an implementation using the TMS320C54x" (PDF). Texas Instruments. p. 5. Archived (PDF) from the original on 14 June 2012. Retrieved 4 July 2012.
  60. Jones, David T. "An Improved 64-bit Cyclic Redundancy Check for Protein Sequences" (PDF). University College London. Archived (PDF) from the original on 7 June 2011. Retrieved 15 December 2009.

Further reading