Milestone-Proposal:Colossus
To see comments, or add a comment to this discussion, click here.
Docket #:2024-03
This is a draft proposal, that has not yet been submitted. To submit this proposal, click on the edit button in toolbar above, indicated by an icon displaying a pencil on paper. At the bottom of the form, check the box that says "Submit this proposal to the IEEE History Committee for review. Only check this when the proposal is finished" and save the page.
To the proposer’s knowledge, is this achievement subject to litigation? No
Is the achievement you are proposing more than 25 years old? Yes
Is the achievement you are proposing within IEEE’s designated fields as defined by IEEE Bylaw I-104.11, namely: Engineering, Computer Sciences and Information Technology, Physical Sciences, Biological and Medical Sciences, Mathematics, Technical Communications, Education, Management, and Law and Policy. Yes
Did the achievement provide a meaningful benefit for humanity? Yes
Was it of at least regional importance? Yes
Has an IEEE Organizational Unit agreed to pay for the milestone plaque(s)? Yes
Has the IEEE Section(s) in which the plaque(s) will be located agreed to arrange the dedication ceremony? Yes
Has the IEEE Section in which the milestone is located agreed to take responsibility for the plaque after it is dedicated? Yes
Has the owner of the site agreed to have it designated as an IEEE Milestone? Yes
Year or range of years in which the achievement occurred:
1943-1945
Title of the proposed milestone:
The Colossus Computers 1944-5
Plaque citation summarizing the achievement and its significance: Text absolutely limited by plaque dimensions to 70 words; 60 is preferable for aesthetic reasons.
Colossus code-breaking computers were installed this building during 1944-5. Designed by Thomas H. Flowers of the British Post Office, they helped obtain intelligence by the process of deciphering secret radio messages transmitted between German Commands across occupied Europe and North Africa, thereby shortening World War 2 and saving many lives. As the first large-scale computing application of digital electronics, Colossus anticipated subsequent computer developments.
200-250 word abstract describing the significance of the technical achievement being proposed, the person(s) involved, historical context, humanitarian and social impact, as well as any possible controversies the advocate might need to review.
The Colossus code breaking machines were developed to attack the World War 2 German Lorenz SZ50/52 teleprinter cipher used to encrypt radio traffic between Berlin and the major German Army Commands across occupied Europe and North Africa.
The use of Colossus machines significantly improved the ability of Bletchley Park to break the Lorenz cipher compared to prior manual techniques and use of electromechanical machines.
Deciphering messages using Colossus made a significant contribution to victory in Europe, due to the strategic nature of the intelligence gained.
Colossus was developed by a team led by Tommy Flowers from the British Post Office research laboratory at Dollis Hill in London.
The first Colossus was delivered to Bletchley Park in January 1944, followed over the next 17 months by a further nine.
For its time, Colossus was an electronic tour-de-force. It used circuits for counting and Boolean algebra functions to perform statistical calculations on encrypted messages. Input was via a 5,000 character per second photoelectric paper tape reader and output to an online typewriter. Containing over 2,400 thermionic valves (vacuum tubes), Colossus was significantly larger than any other contemporary unitary electronic device and ran continuously 24 hours a day, seven days a week. It was programmed using switch panels and jack leads to set up the desired computations. In many respects Colossus anticipated the modern electronic digital computer.
There is controversy around which machine, if any, can be claimed to be “the first computer”. We are seeking recognition of Colossus as the first use of large-scale digital electronics to perform calculations and for its contributions to the Allied victory in 1945.
IEEE technical societies and technical councils within whose fields of interest the Milestone proposal resides.
IEEE Computer Society, IEEE Communications Society
In what IEEE section(s) does it reside?
United Kingdom and Ireland
IEEE Organizational Unit(s) which have agreed to sponsor the Milestone:
IEEE Organizational Unit(s) paying for milestone plaque(s):
Unit: United Kingdom and Ireland
Senior Officer Name: Paul Cunningham (Chair)
IEEE Organizational Unit(s) arranging the dedication ceremony:
Unit: United Kingdom & Ireland
Senior Officer Name: Paul Cunningham (Chair)
IEEE section(s) monitoring the plaque(s):
IEEE Section: United Kingdom and Ireland
IEEE Section Chair name: Paul Cunningham (Chair)
Milestone proposer(s):
Proposer name: Dr Andrew Herbert OBE FREng
Proposer email: Proposer's email masked to public
Please note: your email address and contact information will be masked on the website for privacy reasons. Only IEEE History Center Staff will be able to view the email address.
Street address(es) and GPS coordinates in decimal form of the intended milestone plaque site(s):
Block H, Bletchley Park, Milton Keynes MK3 6EB, United Kingdom
51.9984° N, 0.7437° W
Describe briefly the intended site(s) of the milestone plaque(s). The intended site(s) must have a direct connection with the achievement (e.g. where developed, invented, tested, demonstrated, installed, or operated, etc.). A museum where a device or example of the technology is displayed, or the university where the inventor studied, are not, in themselves, sufficient connection for a milestone plaque.
Please give the address(es) of the plaque site(s) (GPS coordinates if you have them). Also please give the details of the mounting, i.e. on the outside of the building, in the ground floor entrance hall, on a plinth on the grounds, etc. If visitors to the plaque site will need to go through security, or make an appointment, please give the contact information visitors will need. Block-H Bletchley Park, Bletchley UK. Original location of six Colossus machines in 1944-5 and today home of the UK National Museum of Computing (TNMoC).
In 2017 Block H was listed in by Historic England as one of "100 Irreplaceable Places".
Block H is protected with UK "listed grade 2" status as a historically significant building.
The building owned by the Bletchley Park Trust but outside the perimeter of their "Home of The Codebreakers" museum. It is publicly accessible from the main entrance to Bletchley Park via a direct access road to TNMoC.
There is an IEEE Milestone plaque in the "mansion" at the centre of the codebreakers' museum, celebrating the totality of the World War 2 code breaking and intelligence achievements of Bletchley Park.
See https://ethw.org/File:BletchleyParkPlaque.jpg
Are the original buildings extant?
Block H is the only surviving of the two original buildings that housed the ten Colossus machines. The first four Colossus machines were installed in an adjacent Block F which was demolished in recent years to create a car park. The subsequent six machines were located in Block H.
Block H has been accorded "Listed Grade 2 Status" by the Historic Buildings and Monuments Commission for England, signifying that it is 'of special interest, warranting every effort to preserve it'."
Details of the plaque mounting:
On outside of building near main entrance.
How is the site protected/secured, and in what ways is it accessible to the public?
Bletchley Park is a secured site with entrance via a controlled gatehouse. Visitors are able to enter via the main gate and drive/walk to H-Block without payment of a fee. The Bletchley Park Trust web site gives opening times for the park. Generally open all year during day time hours, except for 24th, 25th and 26th December.
Who is the present owner of the site(s)?
The Bletchley Park Trust. The UK National Museum of Computing occupies Block H as a tenant of the Bletchley Park Trust.
What is the historical significance of the work (its technological, scientific, or social importance)? If personal names are included in citation, include justification here. (see section 6 of Milestone Guidelines)
What was the significance of Colossus?
Colossus was the first large-scale application of digital electronics in computing and anticipated many aspects of the modern electronic digital computer.
What was Colossus?
Colossus was a codebreaking machine developed at the British Government Code and Cypher School (GC&CS) at Bletchley Park, in World War 2. Colossus machines were used in the cryptanalysis of the German Lorenz SZ50/52 teleprinter cipher that secured radiotelegraphy messages passing between the German High Command and the German Army Commands in occupied Europe and North Africa. The British code name for messages transmitted using this cipher was "Tunny".
From 1943 onwards the British had developed statistic methods to decrypt intercepted Tunny messages, but these were initially manual and time consuming. Building on the earlier experience of using electromechanical machines to attack the simpler Enigma machine ciphers, Bletchley Park had created an semi-electronic / semi-electromechanical machine called "Heath Robinson" to automate some of the analysis , but the Heath Robinsons were unreliable and still relatively slow. Using digital electronic circuits, Colossus was a major evolutionary step forward with a significant increase in both reliability and speed.
Colossus was the first large-scale application of digital electronics in computing. Colossus used digital circuit elements built from thermionic valves (vacuum tubes) to perform Boolean and counting operations on intercepted messages. Colossus anticipated the subsequent development of computers, in that it was electronic, digital, and programmable. Input consisted of encrypted message text punched on paper tape. "Programs" were set up by manually configuring switches and cables interconnecting connecting telephone jack sockets. By these means it was possible to set up Boolean operations to match patterns on the input tape and to count occurrences of those patterns. Thresholds could be set, that when reached would produce output on an online typewriter.
Colossus was conceived by Thomas Harold Flowers, a research engineer working at the British General Post Office (GPO) research laboratory at Dollis Hill in North London where he was in charge of the 50 strong telephony switching group. Flowers had been involved in the development of the electronic aspects of Heath Robinson and was aware of its limitations. He formed the view that it would be better to have a fully electronic machine. Most of the subsequent electronic design of Colossus was Flowers’ work, with the assistance of his Dollis Hill colleagues William Chandler and Sidney Broadhurst, and then later on Allen Coombs, and also with input from Eric Speight and Arnold Lynch who were responsible for the punched paper-tape input and photoelectric tape-reader.
Work on Colossus began early in 1943. It took Flowers and his team at the Post Office’s Dollis Hill Research laboratory in North London 10 months to complete the machine, working day and night, pushing themselves until (as Flowers said) their “eyes dropped out.” The prototype Colossus first operated successfully in December 1943 at the Post Office’s Dollis Hill Research laboratory in North London and was subsequently transferred to Bletchley Park in January 1944.
An improved Colossus that included shift registers to quintuple the processing speed, first ran satisfactorily on 1 June 1944, just in time for the Normandy landings on D-Day (6th June 1944) and consequent battles until the end of World War 2. In total ten Colossus machines were in use by the end of the war in 1945, all to the improved design, and an eleventh was being commissioned.
Bletchley Park's use of these machines allowed the Allies to obtain a large quantity of strategic high-level military intelligence more quickly and in greater volume than had been possible with the manual methods and electromechanical machines they had relied on prior to the advent of Colossus.
Operating Colossus
The Colossus machines were operated by a part of Bletchley Park known as the “Newmanry”, after its head, the mathematician Max Newman. The Newmanry was staffed by cryptanalysts, operators from the Women's Royal Naval Service (WRNS) – known as “Wrens” – and engineers who were permanently on hand for maintenance and repair. By the end of the war the staff was comprised 272 Wrens and 27 men.
Lorenz messages were intercepted at radio listening post outstations. Here the radio signals were recorded and manually translated into characters from the International Telegraph Alphabet number 2 (ITA 2) and punched to paper tapes which were then sent to Bletchley Park for decryption. The challenge for the codebreakers was to determine the settings of the Lorenz machine used to send the encrypted message, and these setting were changed daily. The codebreakers had developed statistical methods for analysing Tunny messages to determine the machine settings. The machine settings comprised the selection, location and orientation of a set of twelve interlinked rotors forming the encrypting element of the machine. Once the machine settings were known, the message could be decrypted into the original German plaintext and passed to further sections at Bletchley Park for cataloguing and interpretation. The intelligence so gained would then, as appropriate, be distributed to the Allied leadership and command.
The first job in operating Colossus for a new message was to prepare a paper tape loop containing the message to be analysed. This was performed by the Wrens who stuck the two ends of the tape together using glue, ensuring that there was a 150-character length of blank tape between the end and the start of the message. Using a special hand punch, they inserted a start hole between the third and fourth channels 21⁄2 sprocket holes from the end of the blank section, and a stop hole between the fourth and fifth channels 11⁄2 sprocket holes from the end of the characters of the message. These were read by specially positioned photocells and indicated when the message was about to start and when it ended.
The operator would then thread the paper tape through a gate and around the pulleys of a transport mechanism (known as the bedstead on account of its appearance) and adjust the tape tension. The bedstead was arranged such that one tape could be loaded whilst another previous one was being run. A switch controlled whether Colossus read the "near" or the "far" tape in the bedstead.
After performing various resetting and zeroing tasks, the Wren operators would, under instruction from a cryptanalyst, set up a bank of panel switches and jack plug connections for the desired pattern searches. In addition a series of decade switches were set to indicate thresholds at which pattern match counts were to be reported. The Wrens would then start the bedstead tape motor and illuminate the photoelectric tape reader lamp. When the tape was up to speed, they would operate the master start switch. The machine would then run calculating totals according to the programmed settings and the resulting counts would be output to a modified IBM electric typewriter. These would be given to the cryptanalyst who would use the computed results to work out the Lorenz machine settings for the enciphered message and have it translated to German plaintext.
Programming Colossus
Colossus processed each of the individual channels of the paper tape input in parallel. Different processing could be applied to each channel. The programs for each channel were set and held on panel switches (the selection switches) and on jack plugs inserted in a jack field, i.e., a panel of jack sockets. For each channel Colossus could evaluate a Boolean function and count and display the number of times it yielded the specified value of false (0) or true (1) for each pass of the message tape.
Input to the Boolean and counting functions came from two sources: shift registers loaded by reading the paper tape channels as the message tape passed through the photoelectric reader, and from a set of thyratron rings that emulated the rotors of the Lorenz machine. The paper tape reader was photoelectric and ran at 5,000 characters per second.
The message characters on the paper tape were called Z and the keystream characters from the Lorenz emulator were referred to by the Greek letters associated with the χ (chi) and ψ (psi) wheels. On the selection panel, switches specified either Z or ΔZ, either χ or Δχ and either ψ or Δψ for the data to be passed to the jack field and the switch panel. (The symbol Δ denoting the difference between successive bits in a channel.) Additionally, the signals from the wheel simulators could be specified as stepping on with each new pass of the message tape or not.
The switch panel had one group of switches (on the left-hand side of Colossus) to specify the algorithm. Switches on the right-hand side selected the counter to which the result was fed. The plugboard allowed Boolean conditions to be imposed on the counts. Overall, the switches and the plugboard allowed for about five billion different combinations of the selected variables.
As an example: a set of runs for a message tape might initially involve two chi wheels. Such a two-wheel run was called a long run, taking on average eight minutes unless the parallelism was utilised to cut the time by a factor of five. The subsequent runs might only involve setting one chi wheel, giving a short run taking about two minutes. Initially, after the initial long run, the choice of the next algorithm to be tried was specified by the cryptanalyst. Experience showed, however, that pre-planned decision trees for this iterative process could be produced for use by the Wren operators in a proportion of cases.
Colossus and the Modern Computer
In technical terms, for modern audiences, the term "computer" is generally accepted to mean a general purpose, programmable, electronic, digital machine executing programs held in an addressable read-write memory and thus rules out mechanical, electromechanical, analogue machines and fixed function machines. Although the Colossus was the first electronic digital machine with programmability, albeit limited by modern standards, it was not a general-purpose machine, being designed for a range of cryptanalytic tasks, most involving counting the results of evaluating Boolean algorithms. Nor did not store its program in an addressable read-write memory.
The most appropriate claim for Colossus is that it deserves recognition as the first use of large-scale digital electronics to perform calculations and for its contribution to the Allied victory in 1945. It anticipated many elements of the modern computer – input, output, circuits for Boolean operations, counting and shift registers and programmability. It proved that large scale electronic systems could be reliable and outperform the contemporaneous electromechanical computing devices by several orders of magnitude.
The impact of Colossus on Subsequent Developments
Colossus and the reasons for its construction were highly secret and remained so for 30 years after World War 2. Consequently, it was not included in accounts of the history of computing hardware for many years, and Flowers and his associates were deprived of the recognition they were due. All but two of the Colossus machines were dismantled after the war and parts returned to the Post Office. Some parts, sanitised as to their original purpose, were taken to Max Newman’s Royal Society Computing Machine Laboratory at Manchester University where the world’s first electronic digital stored-program computer to use a read-write memory was developed and demonstrated in 1948. The surviving Colossus machines were moved to GCHQ's new headquarters at Eastcote in April 1946, and then to Cheltenham between 1952 and 1954. One of them known as Colossus Blue, was dismantled in 1959; the other, Colossus Red, in the 1960s. Tommy Flowers was ordered to destroy all documentation. He duly burnt them in a furnace and later said of the order: “That was a terrible mistake. I was instructed to destroy all the records, which I did. I took all the drawings and the plans and all the information about Colossus on paper and put it in the boiler fire. And saw it burn”. Fortunately Coombs's documentation survived.
The retained machines were adapted for other purposes, with varying degrees of success; in their later years they were used for training. Jack Good related how he was the first to use Colossus after the war, persuading the US National Security Agency that it could be used to perform a function for which they were planning to build a special-purpose machine. Colossus was also used to perform character counts on one-time pad tapes to test for non-randomness. In 2024, celebrating the 80th anniversary of the arrival of the first Colossus at Bletchley Park GCHQ released three photographs showing one of the surviving machines in a modified form together with some blueprints of Colossus’s inner workings.
A small number of people who were associated with Colossus — and knew that large-scale, reliable, high-speed electronic digital computing devices were feasible — played significant roles in early computer work in the UK and probably in the US. However, with Colossus being so secret, they could not reveal the source of their knowledge of electronic digital computing devices. Thus Colossus had limited direct influence on the development of later computers, although many of those associated with Colossus went on to become post war computing pioneers in the UK. Herman Goldstine, an ENIAC pioneer, from the USA, who was unaware of Colossus and its legacy to the projects of people such as Alan Turing (ACE) and Max Newman (early Manchester computers) questioned why “Britain had such vitality that it could immediately after the war embark on so many well-conceived and well-executed projects in the computer field”. In response, Professor Brian Randell, of Newcastle University, UK, who unearthed information about Colossus in the 1970s, commented on this, saying that: “It is my opinion that the Colossus project was an important source of this vitality, one that has been largely unappreciated, as has the significance of its places in the chronology of the invention of the digital computer".
Colossus Revealed
The first public information about the Colossus machines only appeared in 1972, arising from the research into the origins of digital computers by Brian Randell. He published an article entitled "On Alan Turing and the Origins of Digital Computers" which pulled together fragments of anecdotal information from multiple sources to first describe Colossus. As he states in the paper, he approached the British Government, through the Prime Minister of the time, to seek the official release of information about Colossus. His request was rejected on the grounds of national security and even denial that there been British World War 2 developments in digital computing.
The secrecy about Bletchley Park was been broken when Group Captain Winterbotham published his book The Ultra Secret in 1974.
In October 1975, the first acknowledgement of the existence of Colossus by the UK Government came in a series of captioned photographs of a Colossus were released by the UK Public Record Office.
Using on these photographs and his ongoing research, Randell obtained permission to present a paper at a conference on the history of computing held at the Los Alamos Scientific Laboratory, New Mexico, USA in June 1976 on wartime development of the Colossus at the Post Office Research Station, Dollis Hill. The interest in his paper resulted in a special evening meeting when Randell and accompanied by Coombs answered further questions. Coombs told the audience, “no member of our team could ever forget the fellowship, the sense of purpose and, above all, the breathless excitement of those days”.
The following year (1977) Randell published a further article, "The First Electronic Computer", in February edition of the UK popular science magazine "New Scientist", sharing the story of Colossus with the wider general public.
Since that time there has been considerable ongoing research into Colossus, the team that designed and built it, and how it was applied to breaking the Tunny machine. In 1983 a special edition of the IEEE journal, "The Annals of the History of Computing", was dedicated to Colossus and contained a series of papers written by the pioneers who designed and built the machines revealing more details of the machines, their construction and operation.
Eventually, in October 2000, GCHQ , the post war successor to GC&CS, deposited in the UK Public Records office a 500-page technical report on the Tunny cipher and its cryptanalysis—entitled "General Report on Tunny". This report written by Bletchley staff in 1945 at the end of the war laid out, for the first time in public, the whole incredible story of the Lorenz cipher and Colossus, and it contains a fascinating eulogy to Colossus by the cryptographers who worked with it: “It is regretted that it is not possible to give an adequate idea of the fascination of a Colossus at work; its sheer bulk and apparent complexity; the fantastic speed of thin paper tape round the glittering pulleys; the childish pleasure of not-not, span, print main header and other gadgets; the wizardry of purely mechanical decoding letter by letter (one novice thought she was being hoaxed); the uncanny action of the typewriter in printing the correct scores without and beyond human aid; the stepping of the display; periods of eager expectation culminating in the sudden appearance of the longed-for score; and the strange rhythms characterizing every type of run: the stately break-in, the erratic short run, the regularity of wheel-breaking, the stolid rectangle interrupted by the wild leaps of the carriage-return, the frantic chatter of a motor run, even the ludicrous frenzy of hosts of bogus scores.”
In 2015, Wiley-IEEE Press published "Breaking Teleprinter Ciphers at Bletchley Park: An edition of I.J. Good, D. Michie, G. Timms – General Report on Tunny with Emphasis on Statistical Methods (1945)". This was an annotated version of the original General Report with commentary that clarified the often difficult language of the original and fitted it into a variety of contexts arising out of several separate but intersecting story lines, some only implicit in the original, including an exploration of the likely roots of the ideas entering into the Tunny cryptanalysis, examples of original worksheets, and printouts of the Tunny-breaking process in action along with additional commentary, biographies, glossaries, essays, and bibliographies.
A functioning reconstruction of a Colossus was completed in 2008 by Tony Sale and a team of volunteers at the UK National Museum of Computing at Bletchley Park where it can be visited and is demonstrated throughout the day when the museum is open.
What obstacles (technical, political, geographic) needed to be overcome?
Technical Obstacles
Colossus was the result of overcoming two technical obstacles: the first being the development of computational methods for decoding Lorenz messages and the second being the first ever construction of a large scale electronic computing system to perform computation quickly and reliably. In terms of political obstacles there was great initial skepticism from the management at Bletchley Park that such a machine could be made to work, since it would be several orders of magnitude larger and more complex than contemporary use of electronics in radio and radar systems. It is fortunate that Flowers had the prior experience to be confident in his design for Colossus, and the tacit support of the Dollis Hill management that enabled him to build the prototype Colossus which so stunned the Bletchley code breakers.
Breaking Tunny
In 1940 GC&CS became aware that the Germans were using teleprinter like stream cipher machines interconnected through a radio transmission system to carry messages encoded in the 5-bit International Telegraphy Alphabet No. 2 (ITA2). The British learned that the Germans called the system Sägefisch (Sawfish) and this led GC&CS to call the German teleprinter traffic "Fish", and the unknown machine as "Tunny" (i.e. tuna fish) and its messages as "Tunny traffic".
In fact, the Germans had developed several online Geheimschreiber (secret writer) stream cipher machines. The principal of these and the one used for the Tunny traffic was the Lorenz SZ50/52 (SZ for Schlüssel-Zusatz, meaning "cipher attachment").
The Lorenz machine had twelve rotating wheels and used a Vernam ciphering technique on message characters encoded in the standard 5-bit ITA2 telegraph alphabet. It did this by combining the plaintext characters with a stream of key characters using the XOR Boolean function to produce the ciphertext. The key stream was generated by the wheels which were divided into two sets of 5 called χ (“chi”), and ψ (“psi”) respectively and a further pair of “motor” wheels called μ (“mu”). Each wheel had a series of cams (or pins) around their circumference. These cams could be set in a raised (active) or lowered (inactive) position. In the raised position they generated a ‘1’ which when Xor'd with a bit reversed its value; in the lowered position they generated a ‘0’ which, when XOR-ed, left the bit unchanged. The number of cams on each wheel equalled the number of impulses needed to cause them to complete a full rotation. These numbers were all co-prime, giving the longest possible sequence before the pattern repeated. This is the product of the number of positions of the wheels. For the set of χ wheels it was 41 × 31 × 29 × 26 × 23 = 22,041,682 and for the ψ wheels it was 43 × 47 × 51 × 53 × 59 = 322,303,017. Thus, the number of different ways that all twelve wheels could be set was 1.603×1019 i.e. 16 billion, billion.
The set of five χ wheels all moved on one position after each character had been enciphered. The five ψ wheels, however, advanced intermittently. Their movement was controlled by the two μ wheels acting in series. The SZ40 μ61 motor wheel stepped every time but the μ37 motor wheel stepped only if the first motor wheel was a '1'. The ψ wheels then stepped only if the second motor wheel was a ‘1’. With a sufficiently random keystream, a Vernam cipher removes the natural language property of a plaintext message of having an uneven frequency distribution of the different characters, to produce a uniform distribution in the ciphertext. The Lorenz machine did this well.
In August 1941, a blunder by German operators led to the transmission of two slightly different versions of the same message with identical Lorenz machine settings. These were intercepted and worked on at Bletchley Park. First, John Tiltman of the Research Section derived, by hand, a keystream of almost 4000 characters. Then Bill Tutte, a newly arrived member of the Research Section, subsequently joined by colleagues, used this keystream to attempt to work out the logical structure of the Lorenz machine in terms of the number of wheels, the number of cams in each wheel and the stepping mechanism.
From this full understanding of the logical structure of the Lorenz machine, they worked out that, by examining the frequency distribution of the character-to-character changes in the cipher text instead of the individual characters, there was a departure from uniformity which provided a way into the system. This became known as Tutte’s Statistical Method.
To decrypt the transmitted messages, two tasks had to be performed. The first was “wheel breaking”, which was the discovery of the cam patterns for each of the wheels. Each transmission, which often contained more than one message, was enciphered with a different start position for the wheels. Alan Turing invented a pen and paper method of wheel-breaking that became known as “Turingery”.
The second task was “wheel setting”, which involved working out the start positions of the wheels for a particular message and could only be attempted once the cam patterns were known.
The Evolution of Colossus
Newman, head of the Newmanry, advocated building machines to automate Tutte's method. The initial machines were partly electromechanical, partly electronic and dubbed "Heath Robinsons", after a British cartoonist of the period famed for his drawings of implausibly complex and fantastical machines to carry out everyday chores. They were designed by a team at the Post Office Research Centre at Dollis Hill in London, including Tommy Flowers who worked on the electronic aspects, the so-called "combining unit".
Heath Robinson machines worked by reading two paper tapes in parallel, one containing a copy of the message of interest and the other, the {\displaystyle \chi } component of the key. By making the key tape one character longer than the message tape, each of the 1271 starting positions of the {\displaystyle \chi }1 {\displaystyle \chi }2 sequence was tried against the message. A count was amassed for each start position and, if it exceeded a pre-defined set total was printed out. The highest count was the most likely one to be the one with the correct values of {\displaystyle \chi }1 and {\displaystyle \chi }2. With these values, settings of the other χ {\displaystyle \chi } wheels could be tried to break all five χ {\displaystyle \chi } wheel starting positions for this message. This then allowed the effect of the χ {\displaystyle \chi } component of the key to be removed and the resulting modified message attacked by manual methods.
But the Heath Robinson machine had a flaw - its speed was limited by the electro-mechanical components and the paper tapes would often break under the tension required to keep them in step.
The Heath Robinson had two limitations, which provided the incentive to develop a fully electronic alternative, i.e., Colossus. First, the speed of the Heath Robinson was limited by the electro-mechanical devices themselves, with typical switching speeds of 5-20ms. Second, the Heath Robinson required a copy of the message paper tape to be driven side-by-side with a second tape containing the χ (chi) component of the key. These tapes had to be driven at a carefully controlled speed to remain synchronized with themselves and to match the operating speed of the electro-mechanical parts. This proved difficult to do in practice and the Heath Robinson was notorious for breaking the tapes, requiring jobs to be restarted. Heath Robinson could at best operate the paper tapes at 1,000 characters per second.
FLOWERS MASTER STROKE
Colossus embodied three innovations to overcome these two limitations. First, was to move to a digital electronic system capable of switching times measured in microseconds, i.e., three orders of magnitude faster that Heath Robinson. Second, the keystream tape was replaced by a ring of electronic thyratron valves (vacuum tubes) operating at electronic speeds and therefore capable of being electronically synchronized with the message paper tape. This removed the need for the motor drive to be synchronized between two tapes and with the internal logic of the machine. Instead, the message tape was free running at 5,000 characters a second and Colossus synchronized the electronics to the tape, using the sprocket holes as a ‘clock’. This significantly reduced the problems with tape breakages.
The main functional units of the Colossus Mark 2 design were as follows: • A tape transport with an 8-photocell reading mechanism. • A six-character FIFO shift register. • Twelve thyratron ring stores that simulated the Lorenz machine generating a bit-stream for each wheel. • Panels of switches for specifying the program and the "set total". • A set of functional units that performed Boolean operations. • A “span counter” that could suspend counting for part of the tape. • A master control that handled clocking, start and stop signals, counter readout and printing. • Five electronic counters. • An electric typewriter.
Data input to Colossus was by photoelectric reading of a paper tape transcription of the enciphered intercepted message. This was arranged in a continuous loop so that it could be read and re-read multiple times – there being no internal storage for the data. The design overcame the problem of synchronizing the electronics with the speed of the message tape by generating a clock signal from reading its sprocket holes. The speed of operation was thus limited by the mechanics of reading the tape. During development, the tape reader was tested up to 9700 characters per second (53 mph) before the tape disintegrated. 5000 characters/second (40 ft/s (12.2 m/s; 27.3 mph) was settled on as the speed for regular use. Flowers designed a 6-character shift register, which was used both for computing the delta function (ΔZ) and for testing five different possible starting points of Tunny's wheels in the five processors. This five-way parallelism enabled five simultaneous tests and counts to be performed giving an effective processing speed of 25,000 characters per second.
Building Colossus
At the Post Office Research Station before the war, Flowers had explored the feasibility of using valves (vacuum tubes) as digital switches on a large scale in telephone equipment. His work in this area was, it appears, the earliest large-scale use of valves as devices for generating and using binary pulses.23 At this time, the common wisdom was that valves could never be used satisfactorily in large numbers, for they were unreliable, and in a large installation too many would fail in too short a time. However, this opinion was based on experience with radio receivers and the like, which were switched on and off frequently. What Flowers discovered was that, so long as valves were left on, they could operate reliably for very long periods. As Flowers remarked, at the outbreak of war with Germany he was possibly the only person in Britain who realized that valves could be used on a large scale for high-speed digital computing.
At Bletchley Park, when Tutte had explained his Statistical Method for attacking Tunny messages to Newman, Newman suggested using high-speed electronic counters to cope with the huge amount of counting of binary coincidences that the method demanded. This was inspired by Newman’s knowledge of C.E. Wynn-Williams’ prewar work at Cambridge on the electronic counting of α- particle emissions. Alan Turing, in his role as a scientific policy advisor at Bletchley Park, persuaded the authorities that the machine envisaged by Newman should be built and in December 1942, Newman was given the job of developing the requisite machinery. The result was the Heath Robinson, installed at Bletchley Park in June 1943. Although the counters were electronic, Heath Robinson was largely electromechanical; the machine was effective, but slow and unreliable, but Newman was sufficiently encouraged to place an order for more Robinsons with the Post Office.
During the design phase of Heath Robinson there were difficulties with the logic unit – the “combining unit” in the terminology of 1942. The job had been given to F.O. Morrell’s telegraph section at Dollis Hill, and it was proposed to implement XOR by means of a frequency modulator of a type used for voice-frequency telegraph signals. Because this device was analogue, signal noise would accumulate and wrong answers often result. At Turing’s suggestion, Newman approached Flowers for help. Turing and Flowers had worked together previously in connection with a relay-based machine for use against Enigma (this was not the Bombe itself but a machine for automatically decrypting Enigma messages once the settings were known). Flowers and his switching group improved the design of the combining unit and manufactured it.
Flowers did not think much of the Robinson, however. The basic design had been settled before he was called in, and he was sceptical as soon as Morrell (from whom he first learned of the Robinson) told him about it. Flowers doubted that the Robinson would work properly, and in February 1943 he presented Newman with the alternative of a fully electronic machine able to generate the χ-stream (and ψ- and μ-streams) internally. Opinion at Bletchley was that a machine containing the number of valves that Flowers was proposing could not work reliably. Newman pressed ahead with the two-tape machine, leaving Flowers to do as he wished regarding his alternative proposal. On his own initiative, working independently at Dollis Hill, and using some of his own money, Flowers began building the fully electronic machine that he could see was necessary. He embarked on Colossus “in the face of scepticism” from Bletchley Park and “without the concurrence of B.P.” He was fortunate that this work was supported by the management at Dollis Hill.
Flower’s colleague Coombs remembered Flowers, having produced a rough draft of his design, tearing it into pieces that he handed out to his colleagues for them to do the detailed design and get their team to manufacture it.
When the first Colossus was delivered to Bletchley Park in January 1944 Newman was stunned. In Flower’s own words: “I don’t think they (Newman et al.) really understood what I was saying in detail – I am sure they didn’t — because when the first machine was con-structed and working, they obviously were taken aback. They just couldn’t believe it! ... I don’t think they understood very clearly what I was proposing until they actually had the machine”.
Seeing the capability of this first machine it was quickly decided to build and deploy a further 10 to an enhanced design that gave a five-fold improvement in performance over the prototype. This production effort was overseen by Flower’s colleague Coombs. These were in place by V-E Day (8th May 1945). Seven were used for wheel setting and three for wheel breaking. Colossus machines 2, 4, 6, 7 and 9 had an added gadget that produced tables to aid in "Rectangling", a development of the Turing's method for wheel breaking.
What features set this work apart from similar achievements?
Colossus - The Best Kept Secret
The existence of the Colossus machines was kept secret until the mid-1970s and therefore it was omitted from early accounts of the history of the digital electronic computer and and credit for the origin of such machines given to subsequent developments. The fact that the first Colossus was documented as operating from January 1944 and the ten subsequent Colossus machines were constructed and operating before May 1945 pre-dates subsequent claimants to the title "first electronic digital computer": the American ENIAC (Electronic Numerical Integrator and Calculator) was first put to work for practical purposes on December 10, 1945, the Manchester University Small Scale Experimental Machine ("Baby") only ran its first program on 21st June 1948. However the phrase "first electronic digital computer" is an imprecise term and as electronic computer developed other attributes such as "general purpose" and "stored program" have come to be seen as essential to the definition of a "computer". It cannot however be disputed that Colossus was the first large-scale computing application of digital electronics and that Colossus anticipated subsequent electronic computer developments.
Supporting texts and citations to establish the dates, location, and importance of the achievement: Minimum of five (5), but as many as needed to support the milestone, such as patents, contemporary newspaper articles, journal articles, or chapters in scholarly books. 'Scholarly' is defined as peer-reviewed, with references, and published. You must supply the texts or excerpts themselves, not just the references. At least one of the references must be from a scholarly book or journal article. All supporting materials must be in English, or accompanied by an English translation.
The primary evidence in support of the Colossus story is contained within the release by the UK Government of a secret 1945 document written by the Bletchley Park code breakers themselves:
1) Good, Jack; Michie, Donald; Timms, Geoffrey (1945), General Report on Tunny: With Emphasis on Statistical Methods, UK Public Record Office HW 25/4 and HW 25/5.
An annotated version of the report is available with commentary that clarifies the often difficult language of the original and fitting it into a variety of contexts arising out of several separate but intersecting story lines, some only implicit in the original, including an exploration of the likely roots of the ideas entering into the Tunny cryptanalysis, examples of original worksheets, and printouts of the Tunny-breaking process in action along with additional commentary, biographies, glossaries, essays, and bibliographies.
2) Reeds, James A., Whitfield, Diffie and Field, J.V. Breaking Teleprinter Ciphers at Bletchley Park: An edition of I.J. Good, D. Michie, G. Timms – General Report on Tunny with Emphasis on Statistical Methods (1945). Wiley-IEEE Press (2015) 792p. [ISBN 978-0-470-46589-9].
Randell first documented his discovery of information about Colossus in a 1972 paper:
3) [[1]] On Alan Turing and the Origins of Digital Computers]], “Machine Intelligence", 7, Edinburgh University Press, 1972, pp.3-20.
From that time an increasing number of articles and books have been written about Colossus.
The September 1983 issue of the IEEE Annals of the History of Computing was devoted to Colossus and includes accounts by Flowers and his colleagues of the development of Colossus:
4) Flowers, Thomas H. (1983), "The Design of Colossus", Annals of the History of Computing, 5 (3): 239–252, doi:10.1109/MAHC.1983.10079, S2CID 39816473.
5) Coombs, Allen W. M. (1983), "The Making of Colossus", IEEE Annals of the History of Computing, 5 (3): 253–259, doi:10.1109/MAHC.1983.10085, S2CID 597530.
6) Chandler, W. W. (1983), "The Installation and Maintenance of Colossus", IEEE Annals of the History of Computing, 5 (3): 260–262, doi:10.1109/MAHC.1983.10083, S2CID 15674470.
In 2004, based on interviews and on documents only recent declassified at the time, Copeland wrote an Annals of the History of Computing article clarifying the roles played by Thomas Flowers, Alan Turing, William Tutte, and Max Newman in the events leading to the installation of the first Colossus at Bletchley Park, Britain's wartime code-breaking establishment:
7) Copeland, B. J. (December 2004), "Colossus: its origins and originators", IEEE Annals of the History of Computing, 26 (4): 38–45, doi:10.1109/MAHC.2004.26, S2CID 20209254.
In 2006, Copeland edited and published in book form a significant collection of essays, personal recollections and human stories containing information that until then had often been classified wartime material and and which gave important accounts of Colossus, many published for the first time:
8) Copeland, B. Jack, ed. (2006), Colossus: The Secrets of Bletchley Park's Codebreaking Computers, Oxford: Oxford University Press, ISBN 978-0-19-284055-4.
In 2021 Price published a biographical history of Colossus and of the people who built and used it at Bletchley and their post war contributions to digital computing:
9) Price, David A. (2021). Geniuses at War; Bletchley Park, Colossus, and the Dawn of the Digital Age. New York: Knopf. ISBN 978-0-525-52154-9
The impact of the Colossus decrypts on D-Day is told in:
10) Kenyon, David (2019). Bletchley Park and D-Day: The Untold Story of How the Battle for Normandy Was Won. New Haven and London: Yale University Press. ISBN 978-0-300-24357-4.
The argument about the Turing completeness of Colossus is contained in:
11) Wells, B (2004), "A Universal Turing Machine Can Run on a Cluster of Colossi", Abstracts of the American Mathematical Society, 25: 441.
12) Historic England listing of Block H as one of 100 "Irreplaceable Places": https://historicengland.org.uk/campaigns/100-places/science-discovery/#Section4Text
Supporting materials (supported formats: GIF, JPEG, PNG, PDF, DOC): All supporting materials must be in English, or if not in English, accompanied by an English translation. You must supply the texts or excerpts themselves, not just the references. For documents that are copyright-encumbered, or which you do not have rights to post, email the documents themselves to ieee-history@ieee.org. Please see the Milestone Program Guidelines for more information.
Please email a jpeg or PDF a letter in English, or with English translation, from the site owner(s) giving permission to place IEEE milestone plaque on the property, and a letter (or forwarded email) from the appropriate Section Chair supporting the Milestone application to ieee-history@ieee.org with the subject line "Attention: Milestone Administrator." Note that there are multiple texts of the letter depending on whether an IEEE organizational unit other than the section will be paying for the plaque(s).
Please recommend reviewers by emailing their names and email addresses to ieee-history@ieee.org. Please include the docket number and brief title of your proposal in the subject line of all emails.
