Jump to content

Birthday attack

From Wikipedia, the free encyclopedia

A birthday attack is a bruteforce collision attack that exploits the mathematics behind the birthday problem in probability theory. This attack can be used to abuse communication between two or more parties. The attack depends on the higher likelihood of collisions found between random attack attempts and a fixed degree of permutations (pigeonholes). Let be the number of possible values of a hash function, with . With a birthday attack, it is possible to find a collision of a hash function with chance in where is the bit length of the hash output,[1][2] and with being the classical preimage resistance security with the same probability.[2] There is a general (though disputed[3]) result that quantum computers can perform birthday attacks, thus breaking collision resistance, in .[4]

Although there are some digital signature vulnerabilities associated with the birthday attack, it cannot be used to break an encryption scheme any faster than a brute-force attack.[5]: 36 

Understanding the problem

[edit]
Comparison of the birthday problem (1) and birthday attack (2):
In (1), collisions are found within one set, in this case, 3 out of 276 pairings of the 24 lunar astronauts.
In (2), collisions are found between two sets, in this case, 1 out of 256 pairings of only the first bytes of SHA-256 hashes of 16 variants each of benign and malicious contracts.

As an example, consider the scenario in which a teacher with a class of 30 students (n = 30) asks for everybody's birthday (for simplicity, ignore leap years) to determine whether any two students have the same birthday (corresponding to a hash collision as described further). Intuitively, this chance may seem small. Counter-intuitively, the probability that at least one student has the same birthday as any other student on any day is around 70% (for n = 30), from the formula .[6]

If the teacher had picked a specific day (say, 16 September), then the chance that at least one student was born on that specific day is , about 7.9%.

In a birthday attack, the attacker prepares many different variants of benign and malicious contracts, each having a digital signature. A pair of benign and malicious contracts with the same signature is sought. In this fictional example, suppose that the digital signature of a string is the first byte of its SHA-256 hash. The pair found is indicated in green – note that finding a pair of benign contracts (blue) or a pair of malicious contracts (red) is useless. After the victim accepts the benign contract, the attacker substitutes it with the malicious one and claims the victim signed it, as proven by the digital signature.

Terminology

[edit]

In the context of the birthday attack, the key variables are related to the well-known balls and bins problem in probability theory as follows.

n: Number of Inputs (or Balls)

[edit]

The variable n represents the number of inputs (or attempts) being made. In the analogy of the balls and bins problem, n refers to the number of balls that are randomly thrown into H bins. Each input corresponds to throwing a ball into one of the bins (hash values).

H: Number of Hash Values (or Bins)

[edit]

The variable H represents the total number of possible outputs of the hash function. This is the number of unique "bins" that the balls can land in. The total number of hash outputs is often expressed as , where l is the bit length of the hash output. In the balls and bins analogy, H represents the number of bins, each corresponding to a unique hash value.

l: Bit Length of Hash Function Output

[edit]

The variable l refers to the bit length of the hash function’s output. Since a hash function of bit length l can produce unique outputs, the number of possible hash values (or bins) is .

p: Probability of Collision

[edit]

The variable p represents the probability that a collision will occur—that is, the probability that two or more inputs (balls) will be assigned the same output (bin). In a birthday attack, p is often set to 0.5 (50%) to estimate how many inputs are needed to have a 50% chance of a collision.

Summary of Relation to the Balls and Bins Problem

[edit]

The birthday attack can be modeled as a variation of the balls and bins problem. In this problem:

  • Balls represent inputs to the hash function.
  • Bins represent possible outputs of the hash function (hash values).
  • A collision occurs when two or more balls land in the same bin (i.e., two inputs produce the same hash output).


Mathematics

[edit]

Given a function , the goal of the attack is to find two different inputs such that . Such a pair is called a collision. The method used to find a collision is simply to evaluate the function for different input values that may be chosen randomly or pseudorandomly until the same result is found more than once. Because of the birthday problem, this method can be rather efficient. Specifically, if a function yields any of different outputs with equal probability and is sufficiently large, then we expect to obtain a pair of different arguments and with after evaluating the function for about different arguments on average.

We consider the following experiment. From a set of H values we choose n values uniformly at random thereby allowing repetitions. Let p(nH) be the probability that during this experiment at least one value is chosen more than once. This probability can be approximated as

[7]

where is the number of chosen values (inputs) and is the number of possible outcomes (possible hash outputs).

Let n(pH) be the smallest number of values we have to choose, such that the probability for finding a collision is at least p. By inverting this expression above, we find the following approximation

and assigning a 0.5 probability of collision we arrive at

Let Q(H) be the expected number of values we have to choose before finding the first collision. This number can be approximated by

As an example, if a 64-bit hash is used, there are approximately 1.8×1019 different outputs. If these are all equally probable (the best case), then it would take 'only' approximately 5 billion attempts (5.38×109) to generate a collision using brute force.[8] This value is called birthday bound[9] and for l-bit codes, it could be approximated as 2l/2[10] Other examples are as follows:

Bits Possible outputs (H) Desired probability of random collision
(2 s.f.) (p)
10−18 10−15 10−12 10−9 10−6 0.1% 1% 25% 50% 75%
16 216 (~6.5 x 104) <2 <2 <2 <2 <2 11 36 190 300 430
32 232 (~4.3×109) <2 <2 <2 3 93 2900 9300 50,000 77,000 110,000
64 264 (~1.8×1019) 6 190 6100 190,000 6,100,000 1.9×108 6.1×108 3.3×109 5.1×109 7.2×109
96 296 (~7.9×1028) 4.0×105 1.3×107 4.0×108 1.3×1010 4.0×1011 1.3×1013 4.0×1013 2.1×1014 3.3×1014 4.7×1014
128 2128 (~3.4×1038) 2.6×1010 8.2×1011 2.6×1013 8.2×1014 2.6×1016 8.3×1017 2.6×1018 1.4×1019 2.2×1019 3.1×1019
192 2192 (~6.3×1057) 1.1×1020 3.7×1021 1.1×1023 3.5×1024 1.1×1026 3.5×1027 1.1×1028 6.0×1028 9.3×1028 1.3×1029
256 2256 (~1.2×1077) 4.8×1029 1.5×1031 4.8×1032 1.5×1034 4.8×1035 1.5×1037 4.8×1037 2.6×1038 4.0×1038 5.7×1038
384 2384 (~3.9×10115) 8.9×1048 2.8×1050 8.9×1051 2.8×1053 8.9×1054 2.8×1056 8.9×1056 4.8×1057 7.4×1057 1.0×1058
512 2512 (~1.3×10154) 1.6×1068 5.2×1069 1.6×1071 5.2×1072 1.6×1074 5.2×1075 1.6×1076 8.8×1076 1.4×1077 1.9×1077
Table shows number of hashes n(p) needed to achieve the given probability of success, assuming all hashes are equally likely. For comparison, 10−18 to 10−15 is the uncorrectable bit error rate of a typical hard disk.[11] In theory, MD5 hashes or UUIDs, being roughly 128 bits, should stay within that range until about 820 billion documents, even if its possible outputs are many more.

It is easy to see that if the outputs of the function are distributed unevenly, then a collision could be found even faster. The notion of 'balance' of a hash function quantifies the resistance of the function to birthday attacks (exploiting uneven key distribution.) However, determining the balance of a hash function will typically require all possible inputs to be calculated and thus is infeasible for popular hash functions such as the MD and SHA families.[12] The subexpression in the equation for is not computed accurately for small when directly translated into common programming languages as log(1/(1-p)) due to loss of significance. When log1p is available (as it is in C99) for example, the equivalent expression -log1p(-p) should be used instead.[13] If this is not done, the first column of the above table is computed as zero, and several items in the second column do not have even one correct significant digit.

Simple approximation

[edit]

A good rule of thumb which can be used for mental calculation is the relation

which can also be written as

.

or

.

This works well for probabilities less than or equal to 0.5.

This approximation scheme is especially easy to use when working with exponents. For instance, suppose you are building 32-bit hashes () and want the chance of a collision to be at most one in a million (), how many documents could we have at the most?

which is close to the correct answer of 93.

Proofs

[edit]

The birthday attack is a method that exploits the mathematics of collisions in hash functions. Below, we provide upper and lower bounds for the probability of a collision, based on the analogy of the balls and bins problem, and derive key equations.

Birthday Attack - Upper Bound

[edit]

The birthday attack can be modeled as throwing n balls (inputs) into H bins (possible hash outputs). The probability of a collision is bounded by the following equation:

This equation follows from the union bound, which gives an upper bound on the probability that at least one collision occurs. We denote the event that the i-th ball collides with one of the previous balls as . The probability of a collision for the i-th ball is:

Thus, the total probability of a collision after throwing all n balls is bounded by:

This gives the upper bound for the probability of a collision in a hash function.

Birthday Attack - Lower Bound

[edit]

The lower bound for the probability of a collision can be derived by assuming no collision after throwing in i balls, which must all occupy different bins. The probability of no collision after throwing the (i+1)-st ball is:

The total probability of no collision after throwing all n balls is the product of these terms:

By using the inequality , we can approximate this as:

Thus, the probability of at least one collision is bounded below by:

This provides the lower bound for the probability of a collision.

Birthday Attack and Balls and Bins Problem

[edit]

It follows from the above argument that the probability of at least one collision is bounded between:

Letting , an almost sure collision occurs when the number of trials, n, is given by:

This illustrates how the number of inputs required for a collision grows as a function of the bit length of the hash output.

Digital signature susceptibility

[edit]

Digital signatures can be susceptible to a birthday attack or more precisely a chosen-prefix collision attack. A message is typically signed by first computing , where is a cryptographic hash function, and then using some secret key to sign . Suppose Mallory wants to trick Bob into signing a fraudulent contract. Mallory prepares a fair contract and a fraudulent one . She then finds a number of positions where can be changed without changing the meaning, such as inserting commas, empty lines, one versus two spaces after a sentence, replacing synonyms, etc. By combining these changes, she can create a huge number of variations on which are all fair contracts.

In a similar manner, Mallory also creates a huge number of variations on the fraudulent contract . She then applies the hash function to all these variations until she finds a version of the fair contract and a version of the fraudulent contract which have the same hash value, . She presents the fair version to Bob for signing. After Bob has signed, Mallory takes the signature and attaches it to the fraudulent contract. This signature then "proves" that Bob signed the fraudulent contract.

The probabilities differ slightly from the original birthday problem, as Mallory gains nothing by finding two fair or two fraudulent contracts with the same hash. Mallory's strategy is to generate pairs of one fair and one fraudulent contract. For a given hash function is the number of possible hashes, where is the bit length of the hash output. The birthday problem equations do not exactly apply here. For a 50% chance of a collision, Mallory would need to generate approximately hashes, which is twice the number required for a simple collision under the classical birthday problem.

To avoid this attack, the output length of the hash function used for a signature scheme can be chosen large enough so that the birthday attack becomes computationally infeasible, i.e. about twice as many bits as are needed to prevent an ordinary brute-force attack.

Besides using a larger bit length, the signer (Bob) can protect himself by making some random, inoffensive changes to the document before signing it, and by keeping a copy of the contract he signed in his own possession, so that he can at least demonstrate in court that his signature matches that contract, not just the fraudulent one.

Pollard's rho algorithm for logarithms is an example for an algorithm using a birthday attack for the computation of discrete logarithms.

Reverse attack

[edit]

The same fraud is possible if the signer is Mallory, not Bob. Bob could suggest a contract to Mallory for a signature. Mallory could find both an inoffensively-modified version of this fair contract that has the same signature as a fraudulent contract, and Mallory could provide the modified fair contract and signature to Bob. Later, Mallory could produce the fraudulent copy. If Bob doesn't have the inoffensively-modified version contract (perhaps only finding their original proposal), Mallory's fraud is perfect. If Bob does have it, Mallory can at least claim that it is Bob who is the fraudster.

Here are additional details:

1. Original Contract Proposal: Bob proposes a fair contract to Mallory, expecting her to sign it.

2. Mallory’s Modified and Fraudulent Contracts: Instead of signing Bob's contract directly, Mallory creates two versions of the contract

  • One is a slightly modified version of Bob’s contract that seems harmless or "inoffensive" to Bob.
  • The other is a fraudulent contract that benefits Mallory, but crucially, has the same digital signature as the modified version.

3. Mallory Provides the Modified Contract: Mallory signs the modified version and gives it to Bob. The signature on this version is the same as what would appear on the fraudulent contract.

4. Bob’s Risk: If Bob does not keep a copy of the modified version Mallory signed, but only retains the original proposal, he will not have proof of what Mallory agreed to. Later, Mallory can present the fraudulent contract (which carries the same signature) and claim it was the one that was signed.

5. Outcomes:

  • If Bob lacks the modified version, Mallory’s fraudulent contract is indistinguishable from the signed document, enabling perfect fraud.
  • If Bob retains the modified version, Mallory may still claim Bob switched the contracts, creating doubt about who is responsible for the fraud.

See also

[edit]

Notes

[edit]
  1. ^ "Avoiding collisions, Cryptographic hash functions" (PDF). Foundations of Cryptography, Computer Science Department, Wellesley College.
  2. ^ a b Dang, Q H (2012). Recommendation for applications using approved hash algorithms (Report). Gaithersburg, MD: National Institute of Standards and Technology.
  3. ^ Daniel J. Bernstein. "Cost analysis of hash collisions : Will quantum computers make SHARCS obsolete?" (PDF). Cr.yp.to. Retrieved 29 October 2017.
  4. ^ Brassard, Gilles; HØyer, Peter; Tapp, Alain (20 April 1998). "Quantum cryptanalysis of hash and claw-free functions". LATIN'98: Theoretical Informatics. Lecture Notes in Computer Science. Vol. 1380. Springer, Berlin, Heidelberg. pp. 163–169. arXiv:quant-ph/9705002. doi:10.1007/BFb0054319. ISBN 978-3-540-64275-6. S2CID 118940551.
  5. ^ R. Shirey (August 2007). Internet Security Glossary, Version 2. Network Working Group. doi:10.17487/RFC4949. RFC 4949. Informational.
  6. ^ "Birthday Problem". Brilliant.org. Brilliant_(website). Retrieved 28 July 2023.
  7. ^ Bellare, Mihir; Rogaway, Phillip (2005). "The Birthday Problem". Introduction to Modern Cryptography (PDF). pp. 273–274. Retrieved 2023-03-31.
  8. ^ Flajolet, Philippe; Odlyzko, Andrew M. (1990). "Random Mapping Statistics". In Quisquater, Jean-Jacques; Vandewalle, Joos (eds.). Advances in Cryptology — EUROCRYPT '89. Lecture Notes in Computer Science. Vol. 434. Berlin, Heidelberg: Springer. pp. 329–354. doi:10.1007/3-540-46885-4_34. ISBN 978-3-540-46885-1.
  9. ^ See upper and lower bounds.
  10. ^ Jacques Patarin, Audrey Montreuil (2005). "Benes and Butterfly schemes revisited" (PostScript, PDF). Université de Versailles. Retrieved 2007-03-15. {{cite journal}}: Cite journal requires |journal= (help)
  11. ^ Gray, Jim; van Ingen, Catharine (25 January 2007). "Empirical Measurements of Disk Failure Rates and Error Rates". arXiv:cs/0701166.
  12. ^ "CiteSeerX". Archived from the original on 2008-02-23. Retrieved 2006-05-02.
  13. ^ "Compute log(1+x) accurately for small values of x". Mathworks.com. Retrieved 29 October 2017.

References

[edit]
[edit]