48

When I read about World War II, more specifically about the use of cryptography in that war, I get the impression that the Allies were much more successful in breaking the enemy codes than the Axis Powers. Two such successes are particulary important: the breaking of the Enigma code by the Polish and the British and the breaking of the Purple code by the British and the Americans.

My question is: why were the Allies so much better here? Of course, a possibility is that they had a larger pool of highly skilled people. But is that all? Or is it also because their governments decided to bet more on that than the governments of the Axis Powers?

Edit: Thanks to the comments, I am now aware of some successes of the German code breaking and also of the fact that the Germans never had a central cryptography agency. But why is that? And what about Japan?

Rodrigo de Azevedo
  • 1
  • 1
  • 12
  • 25
José Carlos Santos
  • 4,632
  • 5
  • 30
  • 52
  • 26
    The Germans had broken the British merchant marine codes in 1937 or '38. This was a key reason for their successes in various "happy times" for their submariners. This was never alluded to in any deciphered Enigma transmissions, so the british never suspected. If no-one else digs up a refernece and adds this as an answer, I'll do it a bit later. Here is a link to start. – Pieter Geerkens Nov 22 '20 at 09:27
  • 56
    The winners write the history? – Tomas By Nov 22 '20 at 10:01
  • 7
    There might be an asymmetry here: all the Allies needed / wanted to break the German code, while Germany had to fight several enemies. Allies could ignore the Italian, Romanian, Hungarian etc codes, while Germany had to deal with Britts, Americans, USSR at the same time. – Greg Nov 22 '20 at 18:41
  • 4
    @Greg The Allies did not ignore the codes of the other Axis powers. They could be a great resource. Consider if Berlin sends a message to Rome and Rome sends the message to its armies, this gives the Allies multiple opportunities to intercept and decrypt the message. If anything the Allies had a harder job because they had to coordinate their codes between many nations. The general lack of coordination between the Axis powers meant less coordination of their cryptography was necessary... sometimes to detrimental effect of Axis powers using weak encodings. – Schwern Nov 22 '20 at 23:21
  • 15
    @TomasBy sorry, this is completely unfounded. The winners didn't try to downplay German successes in rocketry, aviation, submarine and tank production. – IMil Nov 22 '20 at 23:57
  • 1
    It should be noted that some of the success at cracking Enigma is credited to Alan Turing Bombe Machine at Bletchley Park during the early stages of World War II. – Hot Licks Nov 23 '20 at 00:56
  • 1
    @Schwern Like the Rosetta Stone of Cryptography. – Davidw Nov 23 '20 at 01:00
  • In reality, Allied code-breaking was much hyped myth . For example, they missed all too obvious German concentration of forces for "Wacht am Rhein" – rs.29 Nov 24 '20 at 07:50
  • 3
    Perhaps because the Allies had Alan Turing? – drkvogel Nov 24 '20 at 13:56
  • 4
    @drkvogel And the Nazis had Teichmüller. – Rodrigo de Azevedo Nov 24 '20 at 14:08
  • 3
    @RodrigodeAzevedo Teichmuller is completely unknown outside very small mathematical circles because his contribution is proportionately small. During the war he spent more time on the front lines than he did doing crypto work. Turing was a greater contributor to the effort, by far, and he is proportionately more renowned among the general populace. If you think his existence is somehow enough to disregard Turing's contributions to the Allied efforts, you need to provide evidence to back up those beliefs. – TylerH Nov 24 '20 at 17:01
  • 3
    @RodrigodeAzevedo I agree that general layman popularity isn't a good indicator of intellectual importance, but Turing is also very highly regarded among people in the computer science and cryptography fields, which is at least a better indicator – Kevin Nov 24 '20 at 17:13
  • 3
    @RodrigodeAzevedo Turing was famous well before any movies were made about him. I suspect your frame of reference as a mathematician is playing a big bias here. – TylerH Nov 24 '20 at 18:35
  • 4
    @TylerH I suspect RodrigodeAzevedo's point is that the Germans had access to brilliant people too. If your point is that the Allied used their resources better, fair, but make it explicit, not just an argument ad genium. – Denis Nardin Nov 24 '20 at 18:51
  • one might want to look at http://www.ibiblio.org/hyperwar/ETO/Ultra/SRH-024/index.html or http://www.ibiblio.org/hyperwar/ETO/Ultra/SRH-025/index.html regarding some of the German communications intelligence activities in the Atlantic Theater. – R Leonard Nov 24 '20 at 20:02
  • 1
    I suspect that the Nazis' decimation of German academic institutions (particularly mathematics departments) along political/racial pretexts once they took power played a part. – Spencer Nov 26 '20 at 15:05
  • 1
    @Greg Nazi cryptanalysts actually cracked almost all French and Soviet codes they theoretically could (Soviets widely used single-use pads which were unbreakable) and that influenced the war greatly but is now mostly forgotten. For further info see, e. g., https://chris-intel-corner.blogspot.com/2014/07/the-french-war-ministrys-fld-code.html and https://chris-intel-corner.blogspot.com/2014/07/compromise-of-soviet-codes-in-wwii.html – ain92 Jan 12 '24 at 11:10

3 Answers3

74

Short Answer

Allied superiority in cryptography versus both the Germans and the Japanese can be broadly attributed to (1) better/greater coordination among personnel, awareness of vulnerabilities, and allocation of resources for breaking enemy codes and, (2) the fact that Axis codes were (mostly, though not always) more easy to break than Allied ones. However, it should not be overlooked that the Axis powers did break some important Allied codes, and that some Axis codes were not broken by the Allies.


German Codebreaking vs. Allied Codebreaking

While the Allies were superior in the use of cryptography, the Germans had their successes as well, as detailed in the Wikipedia article German code breaking in World War II. The most notable success was the breaking of many British naval codes by B-Dienst, which proved particularly damaging to transatlantic convoys.

Nonetheless, there was overall Allied superiority in this area and this has been attributed to nine factors by David Kahn in his article Codebreaking in World Wars I and II: The Major Successes and Failures, Their Causes and Their Effects (1980). Kahn divides these nine reasons into two broad categories: (1) internal or technical and, (2) external or general.

For internal or technical, and listed in rough order of importance, Kahn notes:

Allied knowledge of the Enigma: the German use of one main machine versus the Allied use of many; a poorer German machine; and inadequate operating procedures.

On the first of these points,

The Enigma was originally sold to the public. Even though it was modified for government use, and even though the several agencies of government had their own variations of it, the Allies knew its basic layout. To this must be added the information about its keys and operation provided by the spy. Cryptanalytically, this is of course an enormous head start. It is also a great psychological advantage. The Germans did not have these benefits. The British Type-X and the American SIGABA machines were developed in secret.

On the second point,

This use of one machine [Enigma, by the Germans] had several effects. First of all, it meant that the Allies could concentrate more manpower on a single problem. Secondly, the greater volume of messages enciphered in that single system facilitated its solution. Thirdly, a single system increased Allied incentive, because its solution would yield a greater prize than if it were just one system among many. None of these factors operated for the Germans, and it correspondingly depressed their efforts and results.

On the third point, and referring to the American SIGABA,

It was in fact devised a decade after the Enigma, and because the Americans did not begin equipping their army and navy with cipher machines until the late 1930s, they could utilize this more advanced mechanism without losing capital investment. The Germans, who had mechanized a decade earlier, were stuck with an older, weaker machine.

On the fourth point,

...just as the German hardware was poorer, so was their software. Two of their operating procedures proved fatal to many an Enigma cryptogram. One was the flawed keying method used by the Germans before the war and for its first year or so.....This keying method was later changed, but by then Enigma had been cracked. The Allies, on the other hand, used far more secure keying systems which obviated this sort of attack.

Turning to the five external or general reasons,

...the fragmentation of the German organization compared to the unity of the Allied; Germany's aggression, which led to a neglect of cryptology, contrasted with the Allied defensive posture, which emphasised intelligence; the expulsion and killing of the Jews; better Allied luck, and greater German reluctance to face reality.

Kahn asserts that the first of these was the most important:

The Germans had a great many codebreaking agencies. The Chiffrierabteilung of the armed forces high command, Pers Z of the Foreign Office, and Goring's Forschungsamt competed on the highest level. For a time the SD, the Sicherheitsdienstt, the SS's intelligence arm, had its own agency. The army, the navy, and the air force each had its own unit, though there was rather more justification for that. But this multiplicity spread the available manpower, which was scarce to begin with, very thin. And it diffused the codebreaking effort. Contrast this with the concentration of effort at Bletchley Park, Britain's sole codebreaking agency, and with that in America, where the army and navy codebreaking units worked in the closest co-operation.

On the other points, Kahn notes that German recruiting and training were inferior to that of the Allies while, concerning the Jews, the

...exodus or extermination of a whole people, many of them highly intelligent, cost German codebreaking - as it cost German mathematics and German physics - many useful brains.

Finally, the Germans were slow to accept that Enigma had been broken, even when faced with strong evidence. A senior British MI6 officer, F. W. Winterbotham, noted this when he later wrote in The Ultra Secret (1974) that the Germans

...must have been puzzled by our knowledge of their U-boat positions, but luckily they did not accept the fact that we had broken enigma.


Japanese Codebreaking vs. Allied Codebreaking

A key point that needs emphasising here, even more so than for the Germans, is not that the Japanese were inept at codebreaking but rather that they made it much easier for the Americans to break their codes than it should have been. This was especially true of the Imperial Japanese Navy:

William Friedman, the great American cryptologist...noted that while high level US Naval communications security in WW2 was quite adequate for the time, Japanese Naval communications security was quite inadequate and the IJN lacked the ‘experience and knowledge’ to rectify it.

Source: Peter Donovan & John Mack, 'Code Breaking in the Pacific' (2014)

The Japanese did, though, have a significant amount of success in cracking Allied codes:

... the SIGINT abilities of Japan were not as low as has traditionally been thought. The Imperial Japanese Army was able to read the diplomatic codes of the US, Great Britain, France and China, and some of the military codes of China and the Soviet Union.

Source: Kotani Ken, 'Japanese Intelligence in WWII: Successes and Failures' (NIDS Security Reports, 2009)

Also, unlike Japanese Imperial Navy codes,

In the case of the Army, counterintelligence activities were relatively effective, and there were no cases of Army codes being deciphered by the Allies until the final stages of the war.

Source: Kotani Ken

A key reason for the weakness of the Imperial Navy on the intelligence front was that they effectively ignored signs that their codes had been broken but a

... thorough investigation of the cause and countermeasures were not implemented. ....Rear Admiral Ryunosuke Kusaka, who had participated with the assistant chief of staff of the 1st air fleet, stated that “The fact that the planning of the Combined Fleet in relation to the Battle of Midway was leaked to the US side was a major cause of the failure of that operation.” In an Imperial Japanese Navy General Staff diary, it was stated that “the enemy had sensed our plan.” However, even though these suspicions remained in the Imperial Japanese Navy General Staff, the cause of defeat at Midway was basically considered to be technical operational factors, such as problems in cooperation with supply ships and inadequacy in searching for the enemy. Ultimately, the fact that the Japanese codes had been deciphered was not touched upon.

Source: Kotani Ken

One problem for the Japanese was the far-flung nature of their empire; this made it difficult to easily implement code changes. Further,

Commander Chikataka Nakajima who was a specialist in communications within the Navy recalls that “the greatest deficiency in our Navy’s coding plan was inadequate consideration of the fact that our code charts could fall into enemy hands.”

The weak awareness of counterespionage on the part of the Imperial Japanese Navy at the time, and the lack of a self-cleansing function caused a number of problems to arise. When we consider the effects exerted on subsequent naval strategies, they were all serious. Even if one of the codes were taken, the arrogance that “our codes cannot be deciphered” meant that little labor was put into counterintelligence work.

Source: Kotani Ken

Some of these weaknesses would probably have been dealt with had the Japanese army and navy co-operated and learnt from each other (especially the latter from the former). However, as gktscrk pointed out in a comment below, interservice rivalry was fierce, the damage stretching far beyond counter-intelligence.

As for the Japanese failure to break Navajo (and, as noted by jamesqf in a comment below, other Native American) codes, these were exceptionally difficult to crack:

The Navajo language seemed to be the perfect option as a code because it is not written1 and very few people who aren’t of Navajo origin can speak it.

However, the Marine Corps took the code to the next level and made it virtually unbreakable by further encoding the language with word substitution.

Source: 'Navajo Code Talkers and the Unbreakable Code' (CIA)

A further complication for the Japanese was that it was used in the field via portable radios so, without a Navajo speaker to hand, this made it even more secure:

The Navajo language has no definite rules and a tone that is guttural. The language was unwritten at the time1, notes Carl Gorman, one of the 29 original Navajo code talkers. "You had to base it solely on the sounds you were hearing," he says. "This made it very difficult for others to understand."

1. The 'not written' and 'unwritten' bits are not strictly true (see, for example, Schwern's answer here and this article, but it wasn't widely available and new words had to be invented for military terms.

TylerH
  • 111
  • 6
Lars Bosteen
  • 107,936
  • 20
  • 483
  • 554
  • 8
    WRT code talkers, it should also be noted that they weren't just Navajo. So if the Japanese did somehow manage to crack the Navajo language, that did nothing to help them with Cherokee, Choctaw, Lakota... – jamesqf Nov 22 '20 at 17:37
  • 16
    The grand irony is democracies are better organized than the supposedly organized and efficient fascist dictatorships. Dictatorships lack a governing consensus. Dictators must constantly divide people and institutions to keep them weak. They will squabble for power among themselves lest they gather too much power and threaten the dictatorship. Democracies have a governing consensus and can more safely allow concentrations of power and efficiencies without threatening their control. This played out between the Axis powers, they were never allies, they were never coordinated. – Schwern Nov 22 '20 at 23:18
  • 4
    @jamesqf Yes, there were many different languages used, not for security, but it made more code talkers available. Code talkers were a tactical encryption method. "The tank assault will begin at 0630". Even if Japan "cracked" the language, books were freely available, it is extremely unlikely there would be someone who spoke the language available to decode the message in time for it to be relevant. Any obscure language would do. Even Pig Latin and idioms will confuse a non-native listener. See Why were Navajo code talkers used during WW2? – Schwern Nov 22 '20 at 23:28
  • 1
    @Schwern Do you have any reference materials to read up on about this theory? – DKNguyen Nov 23 '20 at 00:44
  • @DKNguyen There's plenty of material about code talkers. Which part are you referring to? Dictatorships vs democracies? – Schwern Nov 23 '20 at 00:52
  • 1
    @Schwern The grand irony. – DKNguyen Nov 23 '20 at 00:59
  • 13
    @Schwern Nice observation. Kahn does mention this (but I left it out as the answer is already long): "There was some co-operation in Germany, of course. But it did not overcome the lethal effects of dispersion, which stemmed ultimately from Hitler's assigning duplicate responsibilities to his underlings so that he could retain ultimate control. The charismatic nature of his leadership enabled him to do this in many areas of government. It facilitated his rule - but it devastated his war effort, including codebreaking." – Lars Bosteen Nov 23 '20 at 01:03
  • @DKNguyen That's much more than can fit into a comment. How about asking a question and linking it here? – Schwern Nov 23 '20 at 01:08
  • 16
    One of my favorite little stories about WWII allied codebreaking was the advantage they had on cracking codes based on their knowledge that at the end of most messages would be the phrase "Heil Hitler" – T.E.D. Nov 23 '20 at 02:37
  • 2
    @Schwern: Tactical messages could also be things like [if I recall from an audio book] "Enemy machine gunner at [coordinates]. Destroy." If one sent such a message in the clear, the enemy could hear it and immediately move. If one used a coding machine that took five minutes to send a coded message, and the machine gunner never stayed put for more than four, the messages would be useless by the time they were received. The ability to relay messages in less than a minute without the enemy knowing about them was a game changer. – supercat Nov 23 '20 at 05:11
  • 4
    @T.E.D.: Partially correct. There were several phrases that frequently occurred at known places, but "Heil Hitler" at the end wasn't it AFAIK. "Oberkommando" / "OKW" or "Wetter" was much more frequent, and even that was far from a "given". You can have a look at historic messages to see how little of a pattern there actually was. The Real WTF that made the Enigma breakable in the first place was the reflector. It doubled the key space, but introduced the one crucial weakness -- that a character could not be encoded into itself. – DevSolar Nov 23 '20 at 07:36
  • 1
    @DevSolar Indeed. I have in the past worked on messaging systems for the armed forces, and weather makes up a good part of it. It changes frequently and it's a lot of data. And that data is repetitive. Another big part is "move there" / "we moved there". – RedSonja Nov 23 '20 at 10:07
  • 1
    Also about code talkers, even if you captured a native speaker (which the Japanese did: https://en.wikipedia.org/wiki/Joe_Kieyoomia#Prisoner_of_war), the military jargon they used was so opaque that they couldn't really figure it out, adding another layer of pseudo-encryption (and unfortunately more misery for Joe Kieyoomia) – llama Nov 23 '20 at 15:40
  • @Schwern: Another aspect of this is that books don't help all that much in understanding spoken language. I can read & write fairly well in several languages, but don't understand the spoken language at all. And then there's Gaelic spelling :-) – jamesqf Nov 23 '20 at 17:18
  • 3
    The 'industrialization' of code breaking, both at Bletchley Park and in the US, was a distinct feature of the Allies. While helped by the close cooperation of the Allies and the various services, the ability to design, manufacture, and run hundreds of machines was only evidenced on the Allies side. – Jon Custer Nov 23 '20 at 17:34
  • Network effects: Is there anything they can't do? – chrylis -cautiouslyoptimistic- Nov 24 '20 at 04:44
  • 1
    It is probably noteworthy that the cooperation you highlight between Allied forces here would have been impossible in Japan where the Army and Navy competed in everything. Sharing intelligence between the two would have been unthinkable—hence also the very weak naval intelligence codes compared to the Army ones. – gktscrk Nov 24 '20 at 06:01
  • @gktscrk Good point, interservice rivalry was a major issue. – Lars Bosteen Nov 24 '20 at 06:55
  • Answer is good, but I think your conclusion is bad : there is really no evidence that Allied code-breaking was better then German. They all had their successes and failures. Japanese and Italians are different matter, they were simply not that advanced . – rs.29 Nov 24 '20 at 08:03
  • 1
    @rs.29 It's not so much my conclusion as that of the sources I read (not all of which are referenced here). Certainly, many sources underplay the successes of the Germans, and I take your point that 'they all had their successes and failures', but (on balance) the Allies seem to have shaded it, not least because their job was easier. That said, I think there's room for a difference of opinion given the difficulty in weighing up the evidence. – Lars Bosteen Nov 24 '20 at 11:10
  • 3
    Regarding weather reporting, the RAF carried out a process called "Gardening". A plane would buzz a known Axis weather station, for a given number of times from a specified direction, and lob a few bombs. That would ensure a coded report in a standardised format containing some known words, known as a "crib", which could simplify finding the day's Enigma key settings. – Paul_Pedant Nov 24 '20 at 11:53
  • @DevSolar There is of course a bit of survivorship bias in those messages; if I read the page correctly, they are recently cracked ones, so they are less likely to have repetitive patterns that would have allowed them to be cracked earlier on. – Radvylf Programs Nov 24 '20 at 23:56
  • Having good cryptographers on board breaking your enemy codes help designing good codes for yourself. – Ángel Nov 25 '20 at 00:36
  • @RedwolfPrograms: That argument works just as well the other way around. ;-) – DevSolar Nov 25 '20 at 06:48
1

The Deceivers by Thaddeus Holt is a history of Allied deception operations in WWII, but it necessarily also covers codebreaking. I'm not sure how objective the book is (it seems to be rehashing some British/American feuds) but it was quite dismissive of Japanese intelligence operations in general. Lots of Allied (British) effort to plant false clues and then the Japanese didn't notice, and instead got the right answers by asking themselves "what is the logical next step for the Allies?"

o.m.
  • 16,991
  • 2
  • 29
  • 61
-1

The Jewish expulsion from Germany is mentioned which might have had an effect but I would suggest that another related effect might be involved: people were put into positions of authority in academia and scientific research based not so much on ability but on their loyalty to the nazi party. Although some capable mathematicians and scientists were indeed loyal nazis, perhaps nazis who were even more loyal ended up being influential despite being not nearly as competent and this could have affected as it did math and physics also the cryptology effort.

Two nazis who were also Nobelists so very competent physicists were Lenard and Stark but both were from the older generation and did their best work in the 19th century. They ended up being influential in "German Physics" but were far from being up-to-date in their understanding of modern physics.

The question then is, who was in charge of the cryptology effort? Was it a nazi mathematician who was not the most competent but only the most loyal? Or could it even have been a military officer familiar with codes used in the ww1 and lacking the mathematical knowledge to even realize that the effort required first-rate mathematicians? Doenitz apparently compromised the codes by using too often and unnecessarily but in a dictatorship, questioning this practice might have been dangerous.

releseabe
  • 1,900
  • 11
  • 16