Milestone-Proposal:Colossus

From IEEE Milestones Wiki


To see comments, or add a comment to this discussion, click here.

Docket #:2024-03

This is a draft proposal, that has not yet been submitted. To submit this proposal, click on the edit button in toolbar above, indicated by an icon displaying a pencil on paper. At the bottom of the form, check the box that says "Submit this proposal to the IEEE History Committee for review. Only check this when the proposal is finished" and save the page.


To the proposer’s knowledge, is this achievement subject to litigation? No

Is the achievement you are proposing more than 25 years old? Yes

Is the achievement you are proposing within IEEE’s designated fields as defined by IEEE Bylaw I-104.11, namely: Engineering, Computer Sciences and Information Technology, Physical Sciences, Biological and Medical Sciences, Mathematics, Technical Communications, Education, Management, and Law and Policy. Yes

Did the achievement provide a meaningful benefit for humanity? Yes

Was it of at least regional importance? Yes

Has an IEEE Organizational Unit agreed to pay for the milestone plaque(s)? Yes

Has the IEEE Section(s) in which the plaque(s) will be located agreed to arrange the dedication ceremony? Yes

Has the IEEE Section in which the milestone is located agreed to take responsibility for the plaque after it is dedicated? Yes

Has the owner of the site agreed to have it designated as an IEEE Milestone? Yes


Year or range of years in which the achievement occurred:

1943-1945

Title of the proposed milestone:

The Colossus Computers, 1944-1945

Plaque citation summarizing the achievement and its significance; if personal name(s) are included, such name(s) must follow the achievement itself in the citation wording: Text absolutely limited by plaque dimensions to 70 words; 60 is preferable for aesthetic reasons.

Six Colossus code-breaking computers operated in this building in 1944-1945. Designed by Thomas H. Flowers of the British Post Office, they enabled deciphering of encrypted radio messages transmitted between German Commands across occupied Europe and North Africa. The resulting military intelligence saved countless lives, and was critical in shortening World War II. As the first successful large-scale computing application of digital electronics, Colossus anticipated subsequent computer developments.

200-250 word abstract describing the significance of the technical achievement being proposed, the person(s) involved, historical context, humanitarian and social impact, as well as any possible controversies the advocate might need to review.

The Colossus code breaking machines were developed to attack the World War II German Lorenz SZ50/52 teleprinter cipher used to encrypt radio traffic between Berlin and the major German Army Commands across occupied Europe and North Africa.

The use of Colossus significantly improved the ability of Bletchley Park to break the Lorenz cipher compared to prior manual methods and electromechanical machines and made a significant contribution to victory in Europe, due to the strategic nature of the intelligence gained.

Colossus was developed by a team led by Tommy Flowers from the British Post Office research laboratory at Dollis Hill in London.

The first Colossus was delivered in January 1944, followed over the next 17 months by a further nine.

For its time, Colossus was an electronic tour-de-force. It used circuits for counting and Boolean algebra functions to perform statistical calculations on encrypted messages. Input was via a 5,000 character per second photoelectric paper tape reader and output to an online typewriter. Containing over 2,400 thermionic valves (vacuum tubes), Colossus was significantly larger than any other contemporary digital electronic device and ran continuously 24 hours a day, seven days a week. It was programmed using switch panels and jack leads to set up the desired computations.

In many respects Colossus anticipated the modern electronic digital computer.

We are seeking recognition of Colossus as the first use of large-scale digital electronics to perform calculations and for its contributions to the Allied victory in 1945.

IEEE technical societies and technical councils within whose fields of interest the Milestone proposal resides.

IEEE Computer Society, IEEE Communications Society

In what IEEE section(s) does it reside?

United Kingdom and Ireland

IEEE Organizational Unit(s) which have agreed to sponsor the Milestone:

IEEE Organizational Unit(s) paying for milestone plaque(s):

Unit: United Kingdom and Ireland
Senior Officer Name: Paul Cunningham (Chair)

IEEE Organizational Unit(s) arranging the dedication ceremony:

Unit: United Kingdom & Ireland
Senior Officer Name: Paul Cunningham (Chair)

IEEE section(s) monitoring the plaque(s):

IEEE Section: United Kingdom and Ireland
IEEE Section Chair name: Paul Cunningham (Chair)

Milestone proposer(s):

Proposer name: Dr Andrew Herbert OBE FREng
Proposer email: Proposer's email masked to public

Please note: your email address and contact information will be masked on the website for privacy reasons. Only IEEE History Center Staff will be able to view the email address.

Street address(es) and GPS coordinates in decimal form of the intended milestone plaque site(s):

Block H, Bletchley Park, Milton Keynes MK3 6EB, United Kingdom

51.9984° N, 0.7437° W

Describe briefly the intended site(s) of the milestone plaque(s). The intended site(s) must have a direct connection with the achievement (e.g. where developed, invented, tested, demonstrated, installed, or operated, etc.). A museum where a device or example of the technology is displayed, or the university where the inventor studied, are not, in themselves, sufficient connection for a milestone plaque.

Please give the address(es) of the plaque site(s) (GPS coordinates if you have them). Also please give the details of the mounting, i.e. on the outside of the building, in the ground floor entrance hall, on a plinth on the grounds, etc. If visitors to the plaque site will need to go through security, or make an appointment, please give the contact information visitors will need. Block-H Bletchley Park, Bletchley UK.

Original location of six Colossus machines in 1944-1945 and today home of the UK National Museum of Computing (TNMoC).

In 2017 Block H was listed in by Historic England as one of "100 Irreplaceable Places".

Block H is protected with UK "listed grade 2" status as a historically significant building.

The building owned by the Bletchley Park Trust but outside the perimeter of their "Home of The Codebreakers" museum. It is publicly accessible from the main entrance to Bletchley Park via a direct access road to TNMoC.

There is an IEEE Milestone plaque in the "mansion" at the centre of the codebreakers' museum, celebrating the totality of the World War II code breaking and intelligence achievements of Bletchley Park.

See https://ethw.org/File:BletchleyParkPlaque.jpg

Are the original buildings extant?

Block H is the only surviving of the two original buildings that housed the ten Colossus machines. The first four Colossus machines were installed in an adjacent Block F which was demolished in recent years to create a car park. The subsequent six machines were located in Block H.

Block H has been accorded "Listed Grade 2 Status" by the Historic Buildings and Monuments Commission for England, signifying that it is 'of special interest, warranting every effort to preserve it'."

Details of the plaque mounting:

On outside of building near main entrance.

How is the site protected/secured, and in what ways is it accessible to the public?

Bletchley Park is a secured site with entrance via a controlled gatehouse. Visitors are able to enter via the main gate and drive/walk to H-Block without payment of a fee. The Bletchley Park Trust web site gives opening times for the park. Generally open all year during day time hours, except for 24th, 25th and 26th December.

Who is the present owner of the site(s)?

The Bletchley Park Trust. The UK National Museum of Computing occupies Block H as a tenant of the Bletchley Park Trust.

What is the historical significance of the work (its technological, scientific, or social importance)? If personal names are included in citation, include detailed support at the end of this section preceded by "Justification for Inclusion of Name(s)". (see section 6 of Milestone Guidelines)

What was the significance of Colossus?

Colossus was the first successful large-scale application of digital electronics in computing and anticipated many aspects of the modern electronic digital computer.

What was Colossus?

Colossus was a codebreaking machine developed at the British Government Code and Cypher School (GC&CS) at Bletchley Park, in World War II. Colossus machines were used in the cryptanalysis of the German Lorenz SZ50/52 teleprinter cipher that secured radiotelegraphy messages passing between the German High Command and the German Army Commands in occupied Europe, Russia and North Africa. The British code name for messages transmitted using this cipher was "Tunny".

From 1943 onwards the British had developed statistic methods to decrypt intercepted Tunny messages, but these were manual and time consuming. Building on the earlier experience of using electromechanical machines to attack the simpler Enigma machine ciphers, Bletchley Park had created an semi-electronic / semi-electromechanical machine called "Heath Robinson" to automate some of the analysis, but the Heath Robinsons were unreliable and still relatively slow. Using digital electronic circuits, Colossus was a major evolutionary step forward with a significant increase in both reliability and speed.

Colossus used digital circuit elements built from thermionic valves (vacuum tubes) to perform Boolean and counting operations on intercepted messages. Colossus anticipated the subsequent development of computers, in that it was electronic, digital, and programmable. Input consisted of encrypted message text punched on paper tape. It was programmed by manually configuring switches and patching cables between telephone jack sockets. By these means it was possible to set up Boolean operations to match patterns on the input tape and to count occurrences of those patterns. Thresholds could be set, that when reached would produce output on an online typewriter.

Colossus was conceived by Thomas (Tommy) Harold Flowers, a research engineer working at the British General Post Office (GPO) research laboratory at Dollis Hill in North London where he was in charge of the 50 strong telephony switching group. Flowers had been involved in the development of the electronic aspects of Heath Robinson and was aware of its limitations. He formed the view that it would be better to have a fully electronic machine. Most of the subsequent electronic design of Colossus was Flowers’ work, with the assistance of his Dollis Hill colleagues William Chandler and Sidney Broadhurst, and then later on Allen Coombs, and also with input from Eric Speight and Arnold Lynch who were responsible for the punched paper-tape input and photoelectric tape-reader.

Work on Colossus began early in 1943. It took Flowers and his team at the Post Office’s Dollis Hill Research laboratory in North London 10 months to complete the machine, working day and night, pushing themselves until (as Flowers said) their “eyes dropped out.” The prototype Colossus first operated successfully in December 1943 at the Post Office’s Dollis Hill Research Laboratory in North London and was subsequently transferred to Bletchley Park in January 1944.

An improved Colossus that included shift registers to quintuple the processing speed, first ran satisfactorily on 1 June 1944, just in time for the Normandy landings on D-Day (6th June 1944) and consequent battles until the end of WW2. In total ten Colossus machines were in use by the end of the war in 1945, all to the improved design, and an eleventh was being commissioned.

Bletchley Park's use of these machines allowed the Allies to obtain a large quantity of strategic high-level military intelligence more quickly and in greater volume than had been possible with the manual methods and electromechanical machines they had relied on prior to the advent of Colossus. As stated in the GC&CS General Report on Tunny (Gold 1945): "[the arrival of Colossus] immediately sent up the output [of decrypted messages] to more than twice its previous level".

A significant example of the intelligence obtained from breaking Tunny relates to D-Day, 6th June 1944, when the Allied forces in World War II launched their seaborne assault on Nazi Germany’s “Fortress Europe” towards Normandy in France. Their biggest fear was that the allied forces would fail to overcome German resistance at the beaches. Fortuitously, in the days immediately before D-Day, the allies received reassuring intelligence that Hitler, the German leader, had fallen for the Allies’ deception efforts: he believed the main attack would come later, to the North at the Pas de Calais, and held back his reserves from counter-attacking the landings. As is told by history, the invasion was successful, and by May 1945 the war in Europe was over and Nazi Germany defeated. This vital intelligence came from the decryption of Tunny transmitted by radio from the German HQ in Berlin. We do not know precise details of how the messages were decrypted but we do know Colossus was available in time to help.

Operating Colossus

Located in F- and H-Block, the Colossus machines were operated by a part of Bletchley Park known as the “Newmanry”, after its head, the mathematician Max Newman. The Newmanry was staffed by cryptanalysts, operators from the Women's Royal Naval Service (WRNS) – known as “Wrens” – and Post Office engineers who were permanently on hand for maintenance and repair. By the end of the war the staff was comprised 272 Wrens and 27 men.

Lorenz messages were intercepted at radio listening post outstations. Here the radio signals were recorded and manually translated into characters from the International Telegraph Alphabet number 2 (ITA 2) and punched to paper tapes which were then sent to Bletchley Park for decryption. The challenge for the codebreakers was to determine the settings of the Lorenz machine used to send the encrypted message, and these settings were changed daily. The machine settings comprised the selection, location and orientation of a set of twelve interlinked rotors forming the encrypting element of the machine. The codebreakers had developed statistical methods for analysing Tunny messages to determine the machine settings. Once the machine settings were known, the message could be decrypted into the original German plaintext and passed to further sections at Bletchley Park for cataloguing and interpretation. The intelligence so gained would then, as appropriate, be distributed to the Allied leadership and command.

The first job in operating Colossus for a new message was to prepare a paper tape loop containing the message to be analysed. This was performed by the Wrens who stuck the two ends of the tape together using glue, ensuring that there was a 150-character length of blank tape between the end and the start of the message. Using a special hand punch, they inserted a start hole between the third and fourth channels 21⁄2 sprocket holes from the end of the blank section, and a stop hole between the fourth and fifth channels 11⁄2 sprocket holes from the end of the characters of the message. These were read by specially positioned photocells and indicated when the message was about to start and when it ended.

The operator would then thread the paper tape through a gate and around the pulleys of a transport mechanism (known as the bedstead on account of its appearance) and adjust the tape tension. The bedstead was arranged such that one tape could be loaded whilst another previous one was being run. A switch controlled whether Colossus read the "near" or the "far" tape in the bedstead.

After performing various resetting and zeroing tasks, the Wren operators would, under instruction from a cryptanalyst, set up a bank of panel switches and jack plug connections for the desired pattern searches. In addition a series of decade switches were set to indicate thresholds at which pattern match counts were to be reported. The Wrens would then start the bedstead tape motor and illuminate the photoelectric tape reader lamp. When the tape was up to speed, they would operate the master start switch. The machine would then run calculating totals according to the programmed settings and the resulting counts would be output to a modified IBM electric typewriter. These would be given to the cryptanalyst who would use the computed results to deduce the Lorenz machine settings for the enciphered message and eventually have it translated to German plaintext.

Programming Colossus

Colossus processed each of the individual channels of the paper tape input in parallel. Different processing could be applied to each channel. The programs for each channel were set and held on panel switches (the selection switches) and on jack plugs inserted in a jack field, i.e., a panel of jack sockets. For each channel Colossus could evaluate a Boolean function and count and display the number of times it yielded the specified value of false (0) or true (1) for each pass of the message tape.

Input to the Boolean and counting functions came from two sources: shift registers loaded by reading the paper tape channels as the message tape passed through the photoelectric reader, and from a set of thyratron rings that emulated the rotors of the Lorenz machine. The paper tape reader was photoelectric and ran at 5,000 characters per second.

The message characters on the paper tape were called Z and the keystream characters from the Lorenz emulator were referred to by the Greek letters associated with the χ (chi) and ψ (psi) wheels. On the selection panel, switches specified either Z or ΔZ, either χ or Δχ and either ψ or Δψ for the data to be passed to the jack field and the switch panel. (The symbol Δ denoting the difference between successive bits in a channel.) Additionally, the signals from the wheel simulators could be specified as stepping on with each new pass of the message tape or not.

The switch panel had one group of switches (on the left-hand side of Colossus) to specify the algorithm to follow. Switches on the right-hand side selected the counter to which the result was fed. The plugboard allowed Boolean conditions to be imposed on the counts. Overall, the switches and the plugboard allowed for about five billion different combinations of the selected variables.

As an example: a set of runs for a message tape might initially involve two chi wheels. Such a two-wheel run was called a long run, taking on average eight minutes unless the parallelism was utilised to cut the time by a factor of five. The subsequent runs might only involve setting one chi wheel, giving a short run taking about two minutes. Initially, after the initial long run, the choice of the next algorithm to be tried was specified by the cryptanalyst. Experience showed, however, that pre-planned decision trees for this iterative process could be produced for use by the Wren operators in a proportion of cases.

Colossus and the Modern Computer

In technical terms, for modern audiences, the term "computer" is generally accepted to mean a general purpose, programmable, electronic, digital machine executing programs held in an addressable read-write memory and thus rules out mechanical, electromechanical, analogue machines and fixed function machines. Although the Colossus was the first electronic digital machine with programmability, albeit limited by modern standards, it was not a general-purpose machine, being designed for a range of cryptanalytic tasks, most involving counting the results of evaluating Boolean algorithms. Nor did not store its "program" in an addressable read-write memory.

The most appropriate claim for Colossus is that it deserves recognition as the first use of large-scale digital electronics to perform calculations and for its contribution to the Allied victory in 1945. It anticipated many elements of the modern computer – input, output, circuits for Boolean operations, counting and shift registers and programmability. It proved that large scale electronic systems could be made reliable and outperform the contemporaneous electromechanical computing devices by several orders of magnitude.

The impact of Colossus on Subsequent Developments

Colossus and the reasons for its construction were highly secret and remained so for 30 years after WW2. Consequently, it was not included in accounts of the history of computing hardware for many years, and Flowers and his associates were deprived of the recognition they were due. All but two of the Colossus machines were dismantled after the war and parts returned to the Post Office. Some parts, sanitised as to their original purpose, were taken to Max Newman’s Royal Society Computing Machine Laboratory at Manchester University where the world’s first electronic digital stored-program computer to use a read-write memory was developed and demonstrated in 1948. The two surviving Colossus machines were moved to GCHQ's new headquarters at Eastcote in April 1946, and then to Cheltenham between 1952 and 1954. One of them known as Colossus Blue, was dismantled in 1959; the other, Colossus Red, in the 1960s. Tommy Flowers was ordered to destroy all documentation. He duly burnt them in a furnace and later said of the order: “That was a terrible mistake. I was instructed to destroy all the records, which I did. I took all the drawings and the plans and all the information about Colossus on paper and put it in the boiler fire. And saw it burn”. Fortunately Coombs's documentation survived.

The retained machines were adapted for other purposes, with varying degrees of success; in their later years they were used for training. Jack Good, one of the Bletchley cryptographers related how he was the first to use Colossus after the war, persuading the US National Security Agency that it could be used to perform a function for which they were planning to build a special-purpose machine. Colossus was also used to perform character counts on one-time pad tapes to test for non-randomness.

In 2024, celebrating the 80th anniversary of the arrival of the first Colossus at Bletchley Park GCHQ released three photographs showing one of the surviving machines in a modified form together with some blueprints of Colossus’s inner workings.

A small number of people who were associated with Colossus — and therefore knew that large-scale, reliable, high-speed electronic digital computing devices were feasible — played significant roles in early computer work in the UK and probably in the US. However, with Colossus being so secret, they could not reveal the source of their knowledge of electronic digital computing devices. Thus Colossus had limited direct influence on the development of later computers, although many of those associated with Colossus went on to become post war computing pioneers in the UK. Herman Goldstine, an ENIAC pioneer, from the USA, who was unaware of Colossus and its legacy to the projects of people such as Alan Turing (ACE) and Max Newman (early Manchester computers), questioned why “Britain had such vitality that it could immediately after the war embark on so many well-conceived and well-executed projects in the computer field”. In response, Professor Brian Randell, of Newcastle University, UK, who unearthed information about Colossus in the 1970s, commented on this, saying that: “It is my opinion that the Colossus project was an important source of this vitality, one that has been largely unappreciated, as has the significance of its places in the chronology of the invention of the digital computer".

Colossus Revealed

The first public information about the Colossus machines only appeared in 1972, arising from the research into the origins of digital computers by Brian Randell. He published an article entitled "On Alan Turing and the Origins of Digital Computers" which pulled together fragments of anecdotal information from multiple sources to first describe Colossus. As he states in the paper, he approached the British Government, through the Prime Minister of the time, to seek the official release of information about Colossus. His request was rejected on the grounds of national security and even denial that there been British World War II developments in digital computing.

The secrecy about Bletchley Park was broken when Group Captain Winterbotham published his book The Ultra Secret in 1974.

In October 1975, the first acknowledgement of the existence of Colossus by the UK Government came in a series of captioned photographs of a Colossus were released by the UK Public Record Office.

Using on these photographs and his ongoing research, Randell obtained permission to present a paper on the wartime development of the Colossus at the Post Office Research Station, Dollis Hill at a conference on the history of computing held at the Los Alamos Scientific Laboratory, New Mexico, USA in June 1976. The interest in his paper resulted in a special evening meeting when Randell and accompanied by Coombs answered further questions. Coombs told the audience, “no member of our team could ever forget the fellowship, the sense of purpose and, above all, the breathless excitement of those days”.

The following year (1977) Randell published a further article, "The First Electronic Computer", in February edition of the UK popular science magazine "New Scientist", sharing the story of Colossus with the wider general public.

Since that time there has been considerable ongoing research into Colossus, the team that designed and built it, and how it was applied to breaking the Tunny machine.

In 1983 a special edition of the IEEE journal, "The Annals of the History of Computing", was dedicated to Colossus and contained a series of papers written by the pioneers who designed and built the machines revealing more details of the machines, their construction and operation.

Eventually, in October 2000, GCHQ , the post war successor to GC&CS, deposited in the UK Public Records office a 500-page technical report on the Tunny cipher and its cryptanalysis—entitled "General Report on Tunny". This report written by Bletchley staff in 1945 at the end of the war laid out, for the first time in public, the whole incredible story of the Lorenz cipher and Colossus, and it contains a fascinating eulogy to Colossus by the cryptographers who worked with it: “It is regretted that it is not possible to give an adequate idea of the fascination of a Colossus at work; its sheer bulk and apparent complexity; the fantastic speed of thin paper tape round the glittering pulleys; the childish pleasure of not-not, span, print main header and other gadgets; the wizardry of purely mechanical decoding letter by letter (one novice thought she was being hoaxed); the uncanny action of the typewriter in printing the correct scores without and beyond human aid; the stepping of the display; periods of eager expectation culminating in the sudden appearance of the longed-for score; and the strange rhythms characterizing every type of run: the stately break-in, the erratic short run, the regularity of wheel-breaking, the stolid rectangle interrupted by the wild leaps of the carriage-return, the frantic chatter of a motor run, even the ludicrous frenzy of hosts of bogus scores.”

In 2015, Wiley-IEEE Press published "Breaking Teleprinter Ciphers at Bletchley Park: An edition of I.J. Good, D. Michie, G. Timms – General Report on Tunny with Emphasis on Statistical Methods (1945)". This was an annotated version of the original General Report with commentary that clarified the often difficult language of the original and fitted it into a variety of contexts arising out of several separate but intersecting story lines, some only implicit in the original, including an exploration of the likely roots of the ideas entering into the Tunny cryptanalysis, examples of original worksheets, and printouts of the Tunny-breaking process in action along with additional commentary, biographies, glossaries, essays, and bibliographies.

Sadly, The General Report gives little information on the architecture, capability or technology of Colossus - it is focussed more on mathematical and operational aspects of decrypting Tunny messages. It does refer to a parallel technical report on such matters but this has yet to surface in the British national archives. However, working from information in the General Report, descriptions give by Flowers and his colleagues in papers published in the IEEE Annals of Computing in 1983, and anecdotal evidence gather from those who worked at Bletchley and Dollis Hill there is now a fairly complete understanding of the physical and electronic aspects of the machine, written up by several authors (for example: Wells, 2010; Haigh 2018).

A functioning reconstruction of a Colossus was completed in 2008 by Tony Sale and a team of volunteers at the UK National Museum of Computing at Bletchley Park where it can be visited and is demonstrated throughout the day when the museum is open.

Justification for Inclusion of Names

The citation names Tommy Flowers as the designer of Colossus. This is undisputed and supported by multiple sources. The General Report on Tunny written by GC&CS at the end of World War 2 explicitly states in Section 15C(b) Colossus: "Colossus ware entirely the idea of Mr Flowers of Dollis Hill". Flowers himself gives an account of his work in an article in the IEEE Annals of Computing History (Flowers, 1983). His achievement is celebrated by an English Heritage Blue Plaque at the site of the former Dollis Hill Post Office research station, stating Flowers "designed and built the pioneering Colossus computer".

What obstacles (technical, political, geographic) needed to be overcome?

Technical Obstacles

Colossus was the result of overcoming two technical obstacles: the first being the development of computational methods for decoding Lorenz messages and the second being the first ever construction of a large scale electronic computing system to perform computation quickly and reliably. In terms of political obstacles there was great initial skepticism from the management at Bletchley Park that such a machine could be made to work, since it would be several orders of magnitude larger and more complex than contemporary uses of electronics in radio and radar systems. It is fortunate that Flowers had the prior experience from his work on automated telephone switching to be confident in his design for Colossus, and the tacit support of the Dollis Hill management that enabled him to build the prototype Colossus which so stunned the Bletchley code breakers.

Breaking Tunny

In 1940 GC&CS became aware that the Germans were using teleprinter like stream cipher machines interconnected through a radio transmission system to carry messages encoded in the 5-bit International Telegraphy Alphabet No. 2 (ITA2). The British learned that the Germans called the system Sägefisch (Sawfish) and this led GC&CS to call the German teleprinter traffic "Fish", and the unknown machine as "Tunny" (i.e. tuna fish) and its messages as "Tunny traffic".

In fact, the Germans had developed several online Geheimschreiber (secret writer) stream cipher machines. The principal of these and the one used for the Tunny traffic was the Lorenz SZ50/52 (SZ for Schlüssel-Zusatz, meaning "cipher attachment").

The Lorenz machine had twelve rotating wheels and used a Vernam ciphering technique on message characters encoded in the standard 5-bit ITA2 telegraph alphabet. It did this by combining the plaintext characters with a stream of key characters using the XOR Boolean function to produce the ciphertext. The key stream was generated by the wheels which were divided into two sets of 5 called χ (“chi”), and ψ (“psi”) respectively and a further pair of “motor” wheels called μ (“mu”). Each wheel had a series of cams (or pins) around their circumference. These cams could be set in a raised (active) or lowered (inactive) position. In the raised position they generated a ‘1’ which when Xor'd with a bit reversed its value; in the lowered position they generated a ‘0’ which, when XOR-ed, left the bit unchanged. The number of cams on each wheel equalled the number of impulses needed to cause them to complete a full rotation. These numbers were all co-prime, giving the longest possible sequence before the pattern repeated. The number of possible settings of the machine is the product of the number of positions of the wheels. For the set of χ wheels it was 41 × 31 × 29 × 26 × 23 = 22,041,682 and for the ψ wheels it was 43 × 47 × 51 × 53 × 59 = 322,303,017. Thus, the number of different configurations that all twelve wheels could be set was 1.603×1019 i.e. 16 billion, billion.

The set of five χ wheels all moved on one position after each character had been enciphered. The five ψ wheels, however, advanced intermittently. Their movement was controlled by the two μ wheels acting in series. The SZ40 μ61 motor wheel stepped every time but the μ37 motor wheel stepped only if the first motor wheel was a '1'. The ψ wheels then stepped only if the second motor wheel was a ‘1’. With a sufficiently random keystream, a Vernam cipher removes the natural language property of a plaintext message of having an uneven frequency distribution of the different characters, to produce a uniform distribution in the ciphertext. The Lorenz machine did this well.

In August 1941, a blunder by German operators led to the transmission of two slightly different versions of the same message with identical Lorenz machine settings. These were intercepted and worked on at Bletchley Park. First, John Tiltman of the Research Section derived, by hand, a keystream of almost 4000 characters. Then Bill Tutte, a newly arrived member of the Research Section, subsequently joined by colleagues, used this keystream to attempt to work out the logical structure of the Lorenz machine in terms of the number of wheels, the number of cams in each wheel and the stepping mechanism.

From this full understanding of the logical structure of the Lorenz machine, the Bletchley cryptographers worked out that, by examining the frequency distribution of the character-to-character changes in the cipher text instead of the individual characters, there was a departure from uniformity which provided a way into the system. This became known as Tutte’s Statistical Method.

To decrypt the transmitted messages, two tasks had to be performed. The first was “wheel breaking”, which was the discovery of the cam patterns for each of the wheels. Each transmission, which often contained more than one message, was enciphered with a different start position for the wheels. Alan Turing invented a pen and paper method of wheel-breaking that became known as “Turingery”.

The second task was “wheel setting”, which involved working out the start positions of the wheels for a particular message and could only be attempted once the cam patterns were known. Likely chi-wheel settings, could be checked by examining the frequency distribution of the characters in the processed ciphertext, resulting in a "de-chi".

The de-chi would then bepassed to a group led by major Ralph Tester, known as the Tester, where the starting positions of the psi wheels where determined by hand methods. Once psi and chi settings were known a further machine, confusingly also known as "Tunny", would be set up to read in the cipher text and emit plain text for passing on to the intelligence analysis sections at Bletchley. (The Tunny machine was an electromechanical device that used Tutte's model to emulate the German Lorenz machine.)

These techniques, and others, are described in detail in the General Report.

The Evolution of Colossus

Newman, head of the Newmanry, charged with research into machinery to aid in cryptanalysis, advocated building machines to automate Tutte's method. Newman suggested using high-speed electronic counters to cope with the huge amount of counting of binary coincidences that the method demanded. This was inspired by Newman’s knowledge of C.E. Wynn-Williams’ prewar work at Cambridge on the electronic counting of α- particle emissions. Alan Turing, in his role as a scientific policy advisor at Bletchley Park, persuaded the authorities that the machine envisaged by Newman should be built and in December 1942, Newman was given the job of developing the requisite machinery. The machine was partly electromechanical, partly electronic and dubbed "Heath Robinson", after a British cartoonist of the period famed for his drawings of implausibly complex and fantastical machines to carry out everyday chores. The first Heath Robinson was installed at Bletchley Park in June 1943. The machine slow and unreliable, but sufficiently effective that Newman was motivated to place an order for more Robinsons with the Post Office Research Laboratory.

Heath Robinson machines worked by reading two paper tapes in parallel, one containing a copy of the message of interest and the other, the {\displaystyle \chi } component of the key. By making the key tape one character longer than the message tape, each of the 1271 starting positions of the {\displaystyle \chi }1 {\displaystyle \chi }2 sequence was tried against the message. A count was amassed for each start position and, if it exceeded a pre-defined set total was printed out. The highest count was the most likely one to be the one with the correct values of {\displaystyle \chi }1 and {\displaystyle \chi }2. With these values, settings of the other χ {\displaystyle \chi } wheels could be tried to break all five χ {\displaystyle \chi } wheel starting positions for this message. This then allowed the effect of the χ {\displaystyle \chi } component of the key to be removed and the resulting modified message attacked by manual methods.

The Heath Robinson had three limitations. First, the speed of the Heath Robinson was limited by the electro-mechanical devices themselves, with typical switching speeds of 5-20ms. Second, the Heath Robinson required a copy of the message paper tape to be driven side-by-side with a second tape containing the χ (chi) component of the key. These tapes had to be driven at a carefully controlled speed to remain synchronized with themselves and to match the operating speed of the electro-mechanical parts. This proved difficult to do in practice and the Heath Robinson was notorious for breaking the tapes, requiring jobs to be restarted. Heath Robinson could at best operate the paper tapes at 2,000 characters per second. Thirdly, during the design phase of Heath Robinson there were difficulties with its logic unit – the “combining unit” in the terminology of 1942. The job had been given to F.O. Morrell’s telegraph section at Dollis Hill, and it was proposed to implement XOR by means of a frequency modulator of a type used for voice-frequency telegraph signals. Because this device was analogue, signal noise would accumulate and wrong answers often result. At Turing’s suggestion, Newman approached Tommy Flowers from the Post Office Research Laboratory for help. Turing and Flowers had worked together previously in connection with a relay-based machine for use against Enigma (this was not the famous "Bombe" but a machine for automatically decrypting Enigma messages once the settings were known). Flowers was introduced to Tunny and Heath Robinson, and his switching group improved the design of the combining unit and manufactured it. Flowers did not think much of the Robinson, however. The basic design had been settled before he was called in, and he was sceptical as to whether it would work.

Flowers' Master Stroke

Having l contributed to Heath Robinson, Flowers then made two crucial innovative steps leading to Colossus. First, he proposed to move to a fully electronic system capable of switching times measured in microseconds, i.e., three orders of magnitude faster that Heath Robinson. Second, he proposed that the keystream tape bereplaced by a ring of electronic thyratron valves (vacuum tubes) operating at electronic speeds and therefore capable of being electronically synchronized with the message paper tape. This removed the need for the motor drive to be synchronized between two tapes and with the internal logic of the machine. Instead, the message tape was free running at 5,000 characters a second and Colossus synchronized the electronics to the tape, using the sprocket holes as a ‘clock’. This significantly reduced the problems with tape breakages.

The main functional units of the Colossus Mark 2 design were as follows: • A tape transport with an 8-photocell reading mechanism. • A six-character FIFO shift register. • Twelve thyratron ring stores that simulated the Lorenz machine generating a bit-stream for each wheel. • Panels of switches for specifying the program and the "set total". • A set of functional units that performed Boolean operations. • A “span counter” that could suspend counting for part of the tape. • A master control that handled clocking, start and stop signals, counter readout and printing. • Five electronic counters. • An electric typewriter.

Data input to Colossus was by photoelectric reading of a paper tape transcription of the enciphered intercepted message. This was arranged in a continuous loop so that it could be read and re-read multiple times – there being no internal storage for the data. The design overcame the problem of synchronizing the electronics with the speed of the message tape by generating a clock signal from reading its sprocket holes. The speed of operation was thus limited by the mechanics of reading the tape. During development, the tape reader was tested up to 9700 characters per second (53 mph) before the tape disintegrated. 5000 characters/second (40 ft/s (12.2 m/s; 27.3 mph) was settled on as the speed for regular use. Flowers designed a 6-character shift register, which was used both for computing the delta function (ΔZ) and for testing five different possible starting points of Tunny's wheels in the five processors. This five-way parallelism enabled five simultaneous tests and counts to be performed giving an effective processing speed of 25,000 characters per second.

Building Colossus

At the Post Office Research Station before the war, Flowers had explored the feasibility of using valves (vacuum tubes) as for automated large scale telephone switching. His work in this area was, it appears, the earliest large-scale use of valves as devices for the purpose of automatic control. At this time, the common wisdom was that valves could never be used satisfactorily in large numbers, for they were unreliable, and in a large installation too many would fail in too short a time. However, this opinion was based on experience with radio receivers and the like, which were switched on and off frequently. What Flowers discovered was that, so long as valves were left on, they could operate reliably for very long periods. As Flowers remarked, at the outbreak of war with Germany he was possibly the only person in Britain who realized that valves could be used on a large scale for high-speed digital computing.

In February 1943 Flowers had presented Newman with the possibility of a fully electronic machine able to generate the χ-stream (and ψ- and μ-streams) internally to supplant Heath Robinson. Opinion at Bletchley was that a machine containing the number of valves that Flowers was proposing could not work reliably.

Newman pressed ahead with the two-tape Heath Robinson machine, leaving Flowers to do as he wished regarding his alternative proposal. On his own initiative, working independently at Dollis Hill, and using some of his own money, Flowers began building the fully electronic machine that he could see was necessary. He embarked on Colossus “in the face of scepticism” from Bletchley Park and “without the concurrence of B.P.” He was fortunate that this work was supported by the management at Dollis Hill.

When the first Colossus was delivered to Bletchley Park in January 1944 Newman was stunned. In Flower’s own words: “I don’t think they (Newman et al.) really understood what I was saying in detail – I am sure they didn’t — because when the first machine was constructed and working, they obviously were taken aback. They just couldn’t believe it! ... I don’t think they understood very clearly what I was proposing until they actually had the machine”.

Learning of the capability of this first machine, in April 1944 the War Cabinet demanded 12 more machines. Flowers informed them they were dreaming and could only promise one more by 1st June 1944. This was built to an enhanced design that gave a five-fold improvement in performance over the prototype. A further eight were built before the end of the war, at which point an eleventh machine was on the point of being delivered and a twelfth was in manufacture. Flowers was assisted in this production effort by his colleague Coombs. Coombs remembered Flowers, having produced a rough draft of his improved design for the Colossus machines, tearing it into pieces that he handed out to his colleagues for them to do the detailed design and get their team to manufacture it. These enhanced machines were in place by V-E Day (8th May 1945). Seven were used for wheel setting and three for wheel breaking. Colossus machines 2, 4, 6, 7 and 9 had an added gadget that produced tables to aid in "Rectangling", a development of the Turing's method for wheel breaking.

What features set this work apart from similar achievements?

Colossus - The Best Kept Secret

The existence of the Colossus machines was kept secret until the mid-1970s and therefore it was omitted from early accounts of the history of electronic computing and not given the same credit as given to subsequent developments for the origin of the modern computer.

The fact that the first Colossus was documented as operating from January 1944 and the ten subsequent Colossus machines were constructed and operating before May 1945 pre-dates claimants to the title "first electronic digital computer": the American ENIAC (Electronic Numerical Integrator and Calculator) which was first put to work for practical purposes on December 10, 1945 and the Manchester University Small Scale Experimental Machine ("Baby") only ran its first program on 21st June 1948. (These two successor machines are celebrated in separate IEEE Milestone Awards).

The Atanasoff-Berry Computer (1939-42) built at Iowa State University predates Colossus and was electronic, but did not match Colossus in terms of scale (only 300 thermionic tubes compared to 1500-1800), was never fully completed, and was abandoned when Atanasoff left Iowa State and was never saw practical use. The Atanasoff-Berry Computer is also celebrated in a Milestone Award.

It is not being claimed that Colossus was the first "electronic computer": the phrase "electronic computer" is an imprecise term and had no meaning in 1943. As electronic computers developed, other attributes such as: digital", "general purpose" and "stored program" have come to be seen by some as essential to the definition of a "computer". In this respect, Colossus cannot be reasonably described as "general purpose", its purpose was to provide a fast implementation of Tutte's method for statistical analysis of Tunny messages. Colossus lacks a "stored program memory", being "programmed" by setting switches and plugging cables and some debate whether this is indeed programming in the modern sense (Haigh, 2018).

Others of a more theoretical bent link the definition of "computer" to the concept of a "Universal Turing Machine". In that context, Wells (2004) has argued that a Universal Turing Machine can be run on a cluster of Colossus machines. In a later paper Wells (2011) argued further that "a single late Colossus Mark 2 endowed with an appropriate tape punch and controller" can implement a universal Turing machine—specifically Alastair Hewitt's 2-state, 3-symbol machine, proposed in 2007. While interesting, these results are of purely academic interest and do not justify calling Colossus a "computer".

The fact that Colossus was not a computer does not diminish its historical significance. It cannot be disputed that Colossus deserves recognition as the first successful large-scale computing application of digital electronics and that Colossus anticipated many subsequent electronic computer developments. The reliability of Colossus was remarkable for its time, comparable systems such as ENIAC spent over a year in commissioning between being completed to being ready for everyday use. Colossus was delivered to Bletchley Park in January 1944 and in continuous use from February 1944 onwards. The British War Cabinet demanded that the first machine be rapidly followed by a further twelve, of which ten were built and put into operation within 18 months. No other equally complex electronic device of the period was put into production and deployment at this scale.

Why was the achievement successful and impactful?

The use of Colossus significantly improved the ability of Bletchley Park to break the Lorenz cipher compared to prior manual methods and electromechanical machines and made a significant contribution to victory in Europe, due to the strategic nature of the intelligence gained.

For its time, Colossus was an electronic tour-de-force. Colossus was significantly larger than any other contemporary digital electronic device and the machines were run continuously 24 hours a day, seven days a week demonstrating that large scale electronic systems could be reliable and put to continuous practical use. Being entirely electronic, Colossus delivered a step function improvement in codebreaking capability over previous electromechanical machines and hand methods. In the words of the General Report, Colossus doubled the output of decrypted Tunny messages by Bletchley Park.

Colossus was the first successful large-scale application of digital electronics in computing and anticipated many aspects of the modern electronic digital computer.

Several of those who used Colossus went on to make significant contributions to post-World War II electronic computing, even though wartime secrecy forbid them from telling the story of Colossus directly.

Supporting texts and citations to establish the dates, location, and importance of the achievement: Minimum of five (5), but as many as needed to support the milestone, such as patents, contemporary newspaper articles, journal articles, or chapters in scholarly books. 'Scholarly' is defined as peer-reviewed, with references, and published. You must supply the texts or excerpts themselves, not just the references. At least one of the references must be from a scholarly book or journal article. All supporting materials must be in English, or accompanied by an English translation.

The primary evidence in support of the Colossus story is contained within the release by the UK Government of the secret 1945 document written by the Bletchley Park code breakers themselves:

1) Good, Jack; Michie, Donald; Timms, Geoffrey (1945), General Report on Tunny: With Emphasis on Statistical Methods, UK Public Record Office HW 25/4 and HW 25/5.

An annotated version of the report is available with commentary that clarifies the often difficult language of the original and fitting it into a variety of contexts arising out of several separate but intersecting story lines, some only implicit in the original, including an exploration of the likely roots of the ideas entering into the Tunny cryptanalysis, examples of original worksheets, and printouts of the Tunny-breaking process in action along with additional commentary, biographies, glossaries, essays, and bibliographies.

2) Reeds, James A., Whitfield, Diffie and Field, J.V. Breaking Teleprinter Ciphers at Bletchley Park (2015): An edition of I.J. Good, D. Michie, G. Timms – General Report on Tunny with Emphasis on Statistical Methods (1945). Wiley-IEEE Press, 792pp. ISBN 978-0-470-46589-9.
Media:GeneralReport.pdf

Randell first documented his discovery of information about Colossus in a 1972 paper:

3) On Alan Turing and the Origins of Digital Computers , “Machine Intelligence", 7, Edinburgh University Press, 1972, pp.3-20.
Media:On Alan Turing.pdf

From that time an increasing number of articles and books have been written about Colossus.

The September 1983 issue of the IEEE Annals of the History of Computing was devoted to Colossus and includes accounts by Flowers and his colleagues of the development of Colossus:

4) Flowers, Thomas H. (1983), "The Design of Colossus", Annals of the History of Computing, 5 (3): 239–252, DOI:10.1109/MAHC.1983.10079, S2CID 39816473.
Media:Design of Colossus.pdf

5) Coombs, Allen W. M. (1983), "The Making of Colossus", IEEE Annals of the History of Computing, 5 (3): 253–259, DOI:10.1109/MAHC.1983.10085, S2CID 597530.
Media:Making of Colossus.pdf

6) Chandler, W. W. (1983), "The Installation and Maintenance of Colossus", IEEE Annals of the History of Computing, 5 (3): 260–262, DOI:10.1109/MAHC.1983.10083, S2CID 15674470.
Media:Installation and Maintenance of Colossus.pdf

In 2004, based on interviews and on documents only recent declassified at the time, Copeland wrote an Annals of the History of Computing article clarifying the roles played by Thomas Flowers, Alan Turing, William Tutte, and Max Newman in the events leading to the installation of the first Colossus at Bletchley Park, Britain's wartime code-breaking establishment:

7) Copeland, B. J. (December 2004), "Colossus: its origins and originators", IEEE Annals of the History of Computing, 26 (4): 38–45, DOI:10.1109/MAHC.2004.26, S2CID 20209254.
Media:Colossus Origins and Originators.pdf

In 2006, Copeland edited and published in book form a significant collection of essays, personal recollections and human stories containing information that until then had often been classified wartime material and and which gave important accounts of Colossus, many published for the first time:

8) Copeland, B. Jack, ed. (2006), Colossus: The Secrets of Bletchley Park's Codebreaking Computers, Oxford: Oxford University Press, ISBN 978-0-19-284055-4. Paperback edition published in 2010.

In 2021 Price published a biographical history of Colossus and of the people who built and used it at Bletchley and their post war contributions to digital computing:

9) Price, David A. (2021). Geniuses at War; Bletchley Park, Colossus, and the Dawn of the Digital Age. New York: Knopf. ISBN 978-0-525-52154-9.

The impact of the Colossus decrypts on D-Day is told in:

10) Kenyon, David (2019). Bletchley Park and D-Day: The Untold Story of How the Battle for Normandy Was Won. New Haven and London: Yale University Press. ISBN 978-0-300-24357-4.

The argument about the Turing completeness of Colossus is contained in:

11) Wells, B (2004), "A Universal Turing Machine Can Run on a Cluster of Colossi", Abstracts of the American Mathematical Society, 25: 441.
Media:UTM on Cluster Colossi AMS abstract.pdf

12) Wells, B. (2010), "Unwinding Performance and Power on Colossus, an Unconventional Computer", Natural Computing, vol. 10, pp. 1383-1405.
Media:Wells NatComp paper.pdf

A discussion about the "programmability" of Colossus in relation to modern concepts of programming appears the following paper which also gives one of the simpler descriptions of the architecture and capability of Colossus and way in which it was set up for different decryption tasks:

13) Haigh, Thomas & Priestley, Mark, “Colossus and Programmability,” IEEE Annals of the History of Computing 40:4 (Oct-Dec, 2018): 5-27, DOI:10.1109/MAHC.2018.2877912.

Supporting materials (supported formats: GIF, JPEG, PNG, PDF, DOC): All supporting materials must be in English, or if not in English, accompanied by an English translation. You must supply the texts or excerpts themselves, not just the references. For documents that are copyright-encumbered, or which you do not have rights to post, email the documents themselves to ieee-history@ieee.org. Please see the Milestone Program Guidelines for more information.


Please email a jpeg or PDF a letter in English, or with English translation, from the site owner(s) giving permission to place IEEE milestone plaque on the property, and a letter (or forwarded email) from the appropriate Section Chair supporting the Milestone application to ieee-history@ieee.org with the subject line "Attention: Milestone Administrator." Note that there are multiple texts of the letter depending on whether an IEEE organizational unit other than the section will be paying for the plaque(s).

Please recommend reviewers by emailing their names and email addresses to ieee-history@ieee.org. Please include the docket number and brief title of your proposal in the subject line of all emails.