The Thaumatorium:
Where the magic happens

On Computable Numbers, with an Application to the Entscheidungsproblem | The Thaumatorium
ON COMPUTABLE NUMBERS, WITH AN APPLICATION TO THE ENTSCHEIDUNGSPROBLEM
By A. M. TURING.
[Received 28 May, 1936.—Read 12 November, 1936.]

The “computable” numbers may be described briefly as the real numbers whose expressions as a decimal are calculable by finite means. Although the subject of this paper is ostensibly the computable numbers, it is almost equally easy to define and investigate computable functions of an integral variable or a real or computable variable, computable predicates, and so forth. The fundamental problems involved are, however, the same in each case, and I have chosen the computable numbers for explicit treatment as involving the least cumbrous technique. I hope shortly to give an account of the relations of the computable numbers, functions, and so forth to one another. This will include a development of the theory of functions of a real variable expressed in terms of computable numbers. According to my definition, a number is computable if its decimal can be written down by a machine.

In §§ 9, 10 I give some arguments with the intention of showing that the computable numbers include all numbers which could naturally be regarded as computable. In particular, I show that certain large classes of numbers are computable. They include, for instance, the real parts of all algebraic numbers, the real parts of the zeros of the Bessel functions, the numbers π, e, etc. The computable numbers do not, however, include all definable numbers, and an example is given of a definable number which is not computable.

Although the class of computable numbers is so great, and in many ways similar to the class of real numbers, it is nevertheless enumerable. In §8 I examine certain arguments which would seem to prove the contrary. By the correct application of one of these arguments, conclusions are reached which are superficially similar to those of Gödel †. These results have valuable applications. In particular, it is shown (§11) that the Hilbertian Entscheidungsproblem can have no solution.

In a recent paper Alonzo Church † has introduced an idea of “effective calculability”, which is equivalent to my “computability”, but is very differently defined. Church also reaches similar conclusions about the Entscheidungsproblem ‡. The proof of equivalence between “computability” and “effective calculability” is outlined in an appendix to the present paper.

1. Computing machines.

We have said that the computable numbers are those whose decimals are calculable by finite means. This requires rather more explicit definition. No real attempt will be made to justify the definitions given until we reach § 9. For the present I shall only say that the justification lies in the fact that the human memory is necessarily limited.

We may compare a man in the process of computing a real number to a machine which is only capable of a finite number of conditions q1, q2, …, qR which will be called “m-configurations”. The machine is supplied with a “tape” (the analogue of paper) running through it, and divided into sections (called “squares”) each capable of bearing a “symbol”. At any moment there is just one square, say the r-th, bearing the symbol ℭ(r) which is “in the machine”. We may call this square the “scanned square”. The symbol on the scanned square may be called the “scanned symbol”. The “scanned symbol” is the only one of which the machine is, so to speak, “directly aware”. However, by altering its m-configuration the machine can effectively remember some of the symbols which it has “seen” (scanned) previously. The possible behaviour of the machine at any moment is determined by the m-configuration qn and the scanned symbol ℭ(r). This pair qn, ℭ(r) will be called the “configuration”: thus the configuration determines the possible behaviour of the machine. In some of the configurations in which the scanned square is blank (i.e. bears no symbol) the machine writes down a new symbol on the scanned square: in other configurations it erases the scanned symbol. The machine may also change the square which is being scanned, but only by shifting it one place to right or left. In addition to any of these operations the m-configuration may be changed. Some of the symbols written down will form the sequence of figures which is the decimal of the real number which is being computed. The others are just rough notes to “assist the memory”. It will only be these rough notes which will be liable to erasure. It is my contention that these operations include all those which are used in the computation of a number. The defence of this contention will be easier when the theory of the machines is familiar to the reader. In the next section I therefore proceed with the development of the theory and assume that it is understood what is meant by “machine”, “tape”, “scanned”, etc.

2. Definitions.

Automatic machines.

If at each stage the motion of a machine (in the sense of § 1) is completely determined by the configuration, we shall call the machine an “automatic machine” (or a-machine).

For some purposes we might use machines (choice machines or c-machines) whose motion is only partially determined by the configuration (hence the use of the word “possible” in §1). When such a machine reaches one of these ambiguous configurations, it cannot go on until some arbitrary choice has been made by an external operator. This would be the case if we were using machines to deal with axiomatic systems. In this paper I deal only with automatic machines, and will therefore often omit the prefix a-.

Computing machines.

If an a-machine prints two kinds of symbols, of which the first kind (called figures) consists entirely of 0 and 1 (the others being called symbols of the second kind), then the machine will be called a computing machine. If the machine is supplied with a blank tape and set in motion, starting from the correct initial ra-configuration, the subsequence of the synbols printed by it which are of the first kind will be called the sequence computed by the machine. The real number whose expression as a binary decimal is obtained by prefacing this sequence by a decimal point is called the number computed by the machine.

At any stage of the motion of the machine, the number of the scanned square, the complete sequence of all symbols on the tape, and the m-configuration will be said to describe the complete configuration at that stage. The changes of the machine and tape between successive complete configurations will be called the moves of the machine.

Circular and circle-free machines.

If a computing machine never writes down more than a finite number of symbols of the first kind, it will be called circular. Otherwise it is said to be circle-free.

A machine will be circular if it reaches a configuration from which there is no possible move, or if it goes on moving, and possibly printing symbols of the second kind, but cannot print any more symbols of the first kind. The significance of the term “circular” will be explained in §8.

Computable sequences and numbers.

A sequence is said to be computable if it can be computed by a circle-free machine. A number is computable if it differs by an integer from the number computed by a circle-free machine.

We shall avoid confusion by speaking more often of computable sequences than of computable numbers.

3. Examples of computing machines.

I. A machine can be constructed to compute the sequence 010101… . The machine is to have the four m-configurations “𝔟”, “𝔠”, “𝔨”, “𝔢” and is capable of printing “0” and “1”. The behaviour of the machine is described in the following table in which “R” means “the machine moves so that it scans the square immediately on the right of the one it was scanning previously". Similarly for “L”. “E” means “the scanned symbol is erased” and “P” stands for “prints". This table (and all succeeding tables of the same kind) is to be understood to mean that for a configuration described in the first two columns the operations in the third column are carried out successively, and the machine then goes over into the m-configuration described in the last column. When the second column is left blank, it is understood that the behaviour of the third and fourth columns applies for any symbol and for no symbol. The machine starts in the m-configuration 𝔟 with a blank tape.

Configuration Behaviour
m-config. symbol operations final m-config.
𝔟 None P0,R 𝔠
𝔠 None R 𝔢
𝔢 None P1,R 𝔨
𝔨 None R 𝔟

If (contrary to the description in §1) we allow the letters L, R to appear more than once in the operations column we can simplify the table considerably.

m-config. symbol operations final m-config.
𝔟 None P0 𝔟
0 R, R, P1 𝔟
1 R, R, P0 𝔟

II. As a slightly more difficult example we can construct a machine to compute the sequence 001011011101111011111…. The machine is to be capable of five m-configurations, viz. “𝔬”, “𝔮”, “𝔭”, “𝔣”, “𝔟” and of printing “ə” , “𝑥”, “0” , “1” . The first three symbols on the tape will be “ə ə 0”; the other figures follow on alternate squares. On the inter­mediate squares we never print anything but “𝑥”. These letters serve to “keep the place” for us and are erased when we have finished with them. We also arrange that in the sequence of figures on alternate squares there shall be no blanks.

Configuration Behaviour
m-config symbol operations final m-config
𝔟 Pə, R, Pə, R, P0, R, R, P0, L, L 𝔬
𝔬 1 R, P𝑥, L, L, L 𝔬
0 𝔮
𝔮 Any (0 or 1) R, R 𝔮
None P1, L 𝔭
𝔭 𝑥 E, R 𝔮
ə R 𝔣
None L, L 𝔭
𝔣 Any R, R 𝔣
None P0, L, L 𝔬

To illustrate the working of this machine a table is given below of the first few complete configurations. These complete configurations are described by writing down the sequence of symbols which are on the tape, with the m-configuration written below the scanned symbol. The successive complete configurations are separated by colons.

  : ə ə 0   0 : ə ə 0   0 : ə ə 0   0 : ə ə 0   0     : ə ə 0   0   1 :
𝔟       𝔬           𝔮               𝔮               𝔮             𝔭
ə ə 0   0   1 : ə ə 0   0   1 : ə ə 0   0   1 : ə ə 0   0   1 :
      𝔭           𝔭                   𝔣                     𝔣
ə ə 0   0   1 : ə ə 0   0   1     : ə ə 0   0   1   0 :
            𝔣                   𝔣               𝔬
ə ə 0   0   1 𝑥 0 : .
        𝔬

This table could also be written in the form

𝔟 : ə ə 𝔬 0 0 : ə ə 𝔮 0 0 : , (C)

in which a space has been made on the left of the scanned symbol and the m-configuration written in this space. This form is less easy to follow, but we shall make use of it later for theoretical purposes.

The convention of writing the figures only on alternate squares is very useful: I shall always make use of it. I shall call the one sequence of alternate squares F-squares and the other sequence E-squares. The symbols on E-squares will be liable to erasure. The symbols on F-squares form a continuous sequence. There are no blanks until the end is reached. There is no need to have more than one E-square between each pair of F-squares: an apparent need of more E-squares can be satisfied by having a sufficiently rich variety of symbols capable of being printed on E-squares. If a symbol β is on an F-square S and a symbol α is on the E-square next on the right of S, then S> and β will be said to be marked with α. The process of printing this α will be called marking β (or S) with α.

4. Abbreviated tables.

There are certain types of process used by nearly all machines, and. these, in some machines, are used in many connections. These processes include copying down sequences of symbols, comparing sequences, erasing all symbols of a given form, etc. Where such processes are concerned we can abbreviate the tables for the m-configurations considerably by the use of “skeleton tables". In skeleton tables there appear capital German letters and small Greek letters. These are of the nature of “variables". By replacing each capital German letter throughout by an m-configuration and each small Greek letter by a symbol, we obtain the table for an m-configuration.

The skeleton tables are to be regarded as nothing but abbreviations: they are not essential. So long as the reader understands how to obtain the complete tables from the skeleton tables, there is no need to give any exact definitions in this connection.

Let us consider an example:

m-config. Symbol Behavior Final m-config.
𝔣(ℭ, 𝔟, α) ə L 𝔣1(ℭ, 𝔟, α)

From the m-configuration 𝔣(ℭ, 𝔟, α) the machine finds the symbol of form α which is farthest to the left (the “first α") and the m-configuration then becomes ℭ. If there is no α then the m-configuration becomes 𝔟

not ə L 𝔣1(ℭ, 𝔟, α)
𝔣1(ℭ, 𝔟, α) α
not α R 𝔣1(ℭ, 𝔟, α)
None R 𝔣2(ℭ, 𝔟, α)
𝔣2(ℭ, 𝔟, α) α
not α R 𝔣1(ℭ, 𝔟, α)
None R 𝔣2(ℭ, 𝔟, α)

If we were to replace ℭ throughout by 𝔮 (say), 𝔟 by 𝔯, and α by 𝑥, we should have a complete table for the m-configuration 𝔣(𝔮, 𝔯, 𝑥). 𝔣 is called an “m-configuration function” or “m-function".

The only expressions which are admissible for substitution in an m-function are the m-configurations and symbols of the machine. These have to be enumerated more or less explicitly: they may include expressions such as 𝔭(𝔢, 𝑥); indeed they must if there are any m-functions used at all. If we did not insist on this explicit enumeration, but simply stated that the machine had certain m-configurations (enumerated) and all m-configurations obtainable by substitution of m-configurations in certain m-functions, we should usually get an infinity of m-configurations; e.g., we might say that the machine was to have the m-configuration 𝔮 and all m-configurations obtainable by substituting an m-configuration for ℭ in 𝔭(ℭ). Then it would have 𝔮, 𝔭(𝔮), 𝔭(𝔭(𝔮)) 𝔭(𝔭(𝔭(𝔮))), … as m-configurations.

Our interpretation rule then is this. We are given the names of the m-configurations of the machine, mostly expressed in terms of m-functions. We are also given skeleton tables. All we want is the complete table for the m-configurations of the machine. This is obtained by repeated substitution in the skeleton tables.

Further examples.

(In the explanations the symbol “→” is used to signify “the machine goes into the m-configuration. . . . “)

𝔢(ℭ, 𝔟, α) 𝔣(𝔢1(ℭ, 𝔟, α), 𝔟, α) From 𝔢(ℭ, 𝔟, α) the first α is erased and →ℭ. If there is no α→𝔟.
𝔢1(ℭ, 𝔟, α) E
𝔢(𝔟, α) 𝔢(𝔢(𝔟, α), 𝔟, α) From 𝔢(𝔟, α) all letters α are erased and →𝔟.

The last example seems somewhat more difficult to interpret than most. Let us suppose that in the list of m-configurations of some machine there appears 𝔢(𝔟, 𝑥) (=𝔮, say). The table is

𝔢(𝔟, 𝑥) 𝔢(𝔢(𝔟, 𝑥), 𝔟, 𝑥)
or 𝔮 𝔢(𝔮, 𝔟, 𝑥)

Or, in greater detail:

𝔮 𝔢(𝔮, 𝔟, 𝑥)
𝔢(𝔮, 𝔟, 𝑥) 𝔣(𝔢1(𝔮, 𝔟, 𝑥), 𝔟, 𝑥)
𝔢1(𝔮, 𝔟, 𝑥) E 𝔮

In this we could replace 𝔢1(𝔮, 𝔟, 𝑥) by 𝔮′ and then give the table for 𝔣 (with the right substitutions) and eventually reach a table in which no m-functions appeared.

𝔭𝔢(ℭ, β) 𝔣(𝔭𝔢1(ℭ, β), ℭ, ə) From 𝔭𝔢(ℭ, β) the machine prints β at the end of the sequence of symbols and →ℭ.
𝔭𝔢1(ℭ, β) Any R,R 𝔭𝔢1(ℭ, β)
None Pβ
𝔩(ℭ) L From 𝔣′(ℭ, 𝔟, α) it does the same as for 𝔣(ℭ, 𝔟, α) but moves to the left before →ℭ
𝔯(ℭ) R
𝔣′(ℭ, 𝔟, α) 𝔣(𝔩(ℭ), 𝔟, α)
𝔣′′(ℭ, 𝔟, α) 𝔣(𝔯(ℭ), 𝔟, α)
ℭ(ℭ, 𝔟, α) 𝔣′(𝔢1(ℭ), 𝔟, α) 𝔢(ℭ, 𝔟, α). The machine writes at the end the first symbol markes α and →ℭ.
1(ℭ) β 𝔭𝔢(ℭ, β)

The last line stands for the totality of lines obtainable from it by replacing β by any symbol which may occur on the tape of the machine concerned.

ℭ𝔢(ℭ, 𝔟, α) ℭ(𝔢(ℭ, 𝔟, α), 𝔟, α) ℭ𝔢(𝔟, α). The machine copies down in order at the end all symbols marked α and erases the letters α;→𝔟.
ℭ𝔢(𝔟, α) ℭ𝔢(ℭ𝔢(𝔟, α), 𝔟, α)
𝔯𝔢(ℭ, 𝔟, α, β) 𝔣(𝔯𝔢1(ℭ, 𝔟, α, β), 𝔟, α) 𝔯𝔢(ℭ, 𝔟, α, β). The machine replaces the first α by β and →ℭ→𝔟 if there is no α.
𝔯𝔢1(ℭ, 𝔟, α, β) E, Pβ
𝔯𝔢(𝔟, α, β) 𝔯𝔢(𝔯𝔢(𝔟, α, β), 𝔟, α, β) 𝔯𝔢(𝔟, α, β). The machine replaces all letters α by β; →𝔟.
ℭ𝔯(ℭ, 𝔟, α) ℭ(𝔯𝔢(ℭ, 𝔟, α, α), 𝔟, α) ℭ𝔯(𝔟, α) differs from ℭ𝔢(𝔟, α) only in that the letters α are not erased. The m-configuration ℭ𝔯(𝔟, α) is taken up when no letters “α” are on the tape.
ℭ𝔯(𝔟, α) ℭ𝔯(𝔢𝔯(𝔟, α), 𝔯𝔢(𝔟, α, α), α)
ℭ𝔭(ℭ,𝔘,ℭ,α,β) 𝔣′(ℭ𝔭1(ℭ1, 𝔘, β), 𝔣(𝔘, ℭ, β), α)
ℭ𝔭1(ℭ,𝔘,β) γ 𝔣′(ℭ𝔭2(ℭ, 𝔘, γ), 𝔘, β)
ℭ𝔭2(ℭ,𝔘,γ) γ
not γ 𝔘.

The first symbol marked α and the first marked β are compared. If there is neither α nor β,→ℭ. If there are both and the symbols are alike, →ℭ. Otherwise →𝔘.

ℭ𝔭𝔢(ℭ,𝔘,𝔢,α,β) ℭ𝔭(𝔢(𝔢(ℭ, ℭ, β), ℭ, α), 𝔘, 𝔢, α, β)

ℭ𝔭𝔢(ℭ,𝔘,𝔢,α,β) differs from ℭ𝔭(ℭ, 𝔘, 𝔢, α, β) in that in the case when there is similarity the first α and β are erased.

ℭ𝔭𝔢(𝔘,𝔢,α,β) ℭ𝔭𝔢(ℭ𝔭𝔢(𝔘, 𝔢, α, β), 𝔘, 𝔢, α, β), 𝔘, 𝔢, α, β).

ℭ𝔭𝔢(𝔘,𝔢,α,β). The sequence of symbols marked α is compared with the sequence marked β. →𝔢 if they are similar. Otherwise →𝔘. Some of the symbols α and β are erased.

WARNING - MISSING TABLE FROM PAGE 239!!!

5. Enumeration of computable sequences.

A computable sequence γ is determined by a description of a machine which computes y. Thus the sequence 001011011101111… is determined by the table on p.234, and, in fact, any computable sequence is capable of being described in terms of such a table.

It will be useful to put these tables into a kind of standard form. In the first place let us suppose that the table is given in the same form as the first table, for example, I on p. 233. That is to say, that the entry in the operations column is always of one of the forms E:E,R:E,L:Pa:Pa,R:Pa,L:R:L: or no entry at all. The table can always be put into this form by introducing more m-configurations. Now let us give numbers to the m>-configurations, calling them q1, …, qR, as in §1. The initial m-configuration is always to be called q1. We also give numbers to the symbols S1,…, Sm and, in particular, blank = S0, 0 = S1, 1 = S2. The lines of the table are now of form

m-config Symbol Operations Final m-config.
qi Sj PSk, L qm (N1)
qi Sj PSk, R qm (N2)
qi Sj PSk qm (N3)

Lines such as

qi Sj E, R qm

are to be written as

qi Sj PS0, R qm

and the lines such as

qi Sj R qm

to be written as

qi Sj PSj, R qm

In this way we reduce each line of the table to a line of one of the forms (N1), (N2), (N3).

From each line of form (N1) let us form an expression qiSjSkLqm; from each line of form (N2) we form an expression qiSjSkRqm; and from each line of form (N3) we form an expression qiSjSkNqm

Let us write down all expressions so formed from the table for the machine and separate them by semi-colons. In this way we obtain a complete description of the machine. In this description we shall replace qi by the letter “D” followed by the letter “A” repeated i times, and Sj by “D” followed by “C” repeated j times. This new description of the machine may be called the standard description (S.D). It is made up entirely from the letters “A”, “C”, “D”, “L”, “R”, “N”, and from “;"

If finally we replace “A” by “1” , “C” by “2” , “D” by “3” , “L" by “4” , “R” by “5” , “N” by “6” , and “;” by “7” we shall have a description of the machine in the form of an arabic numeral. The integer represented by this numeral may be called a description number (D.N) of the machine. The D.N determine the S.D and the structure of the machine uniquely. The machine whose D.N is n may be described as ℳ(n)

To each computable sequence there corresponds at least one description number, while to no description number does there correspond more than one computable sequence. The computable sequences and numbers are therefore enumerable.

Let us find a description number for the machine I of § 3. When we rename the m-configurations its table becomes:

q1 S0 PS1, R q2
q2 S0 PS0, R q3
q3 S0 PS2, R q4
q4 S0 PS0, R q1

Other tables could be obtained by adding irrelevant lines such as

q1 S1 PS1, R q2

Our first standard form would be

q1S0S1Rq2; q2S0S0Rq3; q3S0S2Rq4; q4S0S0Rq1

The standard description is

DADDCRDAA;DAADDRDAAA;
								 DAAADDCCRDAAA;DAAAADDRDA;

A description number is

31332531173113353111731113322531111731111335317

and so is

3133253117311335311173111332253111173111133531731323253117

A number which is a description number of a circle-free machine will be called a satisfactory number. In §8 it is shown that there can be no general process for determining whether a given number is satisfactory or not.

6. The universal computing machine.

It is possible to invent a single machine which can be used to compute any computable sequence. If this machine 𝒰 is supplied with a tape on the beginning of which is written the S.D of some computing machine ℳ, then 𝒰 will compute the same sequence as ℳ. In this section I explain in outline the behaviour of the machine. The next section is devoted to giving the complete table for 𝒰.

Let us first suppose that we have a machine ℳ′ which will write down on the F-squares the successive complete configurations of ℳ. These might be expressed in the same form as on p. 235, using the second description, (C), with all symbols on one line. Or, better, we could transform this description (as in §5) by replacing each m-configuration by “D” followed by “A” repeated the appropriate number of times, and by replacing each symbol by “D” followed by “C” repeated the appropriate number of times. The numbers of letters “A” and “C” are to agree with the numbers chosen in §5, so that, in particular, “0” is replaced by “DC”, “1” by “DCC”, and the blanks by “D” . These substitutions are to be made after the complete configurations have been put together, as in (C). Difficulties arise if we do the substitution first. In each complete configuration the blanks would all have to be replaced by “D”, so that the complete configuration would not be expressed as a finite sequence of symbols.

If in the description of the machine II of § 3 we replace “𝔬” by “DAA”, “ə” by “DCCC”, “𝔮” by “DAAA”, then the sequence (C) becomes:

DA:DCCCDCCCDAADCDDC:DCCCDCCCDAAADCDDC:… (C1)

(This is the sequence of symbols on F-squares.)

It is not difficult to see that if ℳ can be constructed, then so can it ℳ′. The manner of operation of ℳ′ could be made to depend on having the rules of operation (i.e., the S.D) of ℳ written somewhere within itself {i.e. within ℳ′); each step could be carried out by referring to these rules. We have only to regard the rules as being capable of being taken out and exchanged for others and we have something very akin to the universal machine.

One thing is lacking: at present the machine ℳ′ prints no figures. We may correct this by printing between each successive pair of complete configurations the figures which appear in the new configuration but not in the old. Then (C1) becomes

DDA:0:0:DCCCDCCCDAADCDDC:DCCC... (C2)

It is not altogether obvious that the E-squares leave enough room for the necessary “rough work”, but this is, in fact, the case.

The sequences of letters between the colons in expressions such as (C1) may be used as standard descriptions of the complete configurations. When the letters are replaced by figures, as in § 5, we shall have a numerical description of the complete configuration, which may be called its description number.

7. Detailed description of the universal machine.

A table is given below of the behaviour of this universal machine. The m-configurations of which the machine is capable are all those occurring in the first and last columns of the table, together with all those which occur when we write out the unabbreviated tables of those which appear in the table in the form of m-functions. E.g., 𝔢(𝔞𝔫𝔣) appears in the table and is an m-function. Its unabbreviated table is (see p. 239)

𝔢(𝔞𝔫𝔣) 𝔢1(𝔞𝔫𝔣)

Consequently 𝔢1(𝔞𝔫𝔣) is an m-configuration of 𝒰.

When 𝒰 is ready to start work the tape running through it bears on it the symbol ǝ on an F-square and again ǝ on the next E-square; after this, on F-squares only, comes the S.D of the machine followed by a double colon “::” (a single symbol, on an F-square). The S.D consists of a number of instructions, separated by semi-colons.

Each instruction consists of five consecutive parts

(i) “D” followed by a sequence of letters “A”. This describes the relevant m-configuration.

(ii) “D” followed by a sequence of letters “C”. This describes the scanned symbol.

(iii) “D” followed by another sequence of letters “C”. This describes the symbol into which the scanned symbol is to be changed.

(iv) “L” , “R” , or “N”, describing whether the machine is to move to left, right, or not at all.

(v) “D” followed by a sequence of letters “A”. This describes the final m-configuration.

The machine 𝒰 is to be capable of printing “A”, “C”, “D” , “0”, "1” , “u”, “v”, “w”, “x” , “y”, “z” . The S.D is formed from “;” , “A”, “C”, “D” , “L” , “R”, “N”.

Subsidiary skeleton table.

𝔠𝔬𝔫(ℭ, α) Not A R, R 𝔠𝔬𝔫(ℭ, α) 𝔠𝔬𝔫(ℭ, α). Starting from an F-square, S say, the sequence C of symbols describing a configuration closest on the right of S is marked out with letters α. →ℭ
A L,Pa,R 𝔠𝔬𝔫1(ℭ, α)
𝔠𝔬𝔫1(ℭ, α) A R, Pa, R 𝔠𝔬𝔫1(ℭ, α)
D R, Pa, R 𝔠𝔬𝔫2(ℭ, α)
𝔠𝔬𝔫2(ℭ, α) C R, Pa, R 𝔠𝔬𝔫2(ℭ, α) 𝔠𝔬𝔫(ℭ, ). In the final configuration the machine is scanning the square which is four squares to the right of the last square of C. C is left unmarked
Not C R, R

The table for 𝒰.

𝔟 𝔣(𝔟1, 𝔟1, ::) 𝔟. The machine prints :DA on the F-squares after :: → 𝔞𝔫𝔣.
𝔟1 R, R, P:, R, R, PD, R, R, PA 𝔞𝔫𝔣
𝔞𝔫𝔣 𝔤(𝔞𝔫𝔣1, :) 𝔞𝔫𝔣. The machine marks the configuration in the last complete configuration with 𝔶. →𝔉𝔬𝔪.
𝔞𝔫𝔣1 𝔠𝔬𝔫(𝔉𝔬𝔪, 𝔶)
𝔉 𝔠𝔭𝔢(𝔢(𝔉𝔬𝔪, x, y)

𝔞𝔫𝔣. Taking the long view, the last instruction relevant to the last configuration is found. It can be recognised afterwards as the instruction following the last semi-colon marked z. →𝔰𝔦𝔪.

8. Application of the diagonal process.

It may be thought that arguments which prove that the real numbers are not enumerable would also prove that the computable numbers and sequences cannot be enumerable*. It might, for instance, be thought that the limit of a sequence of computable numbers must be computable. This is clearly only true if the sequence of computable numbers is defined by some rule.

Or we might apply the diagonal process. “If the computable sequences are enumerable, let αn be the n-th computable sequence, and let фn(m) be the m-th figure in αn. Let /? be the sequence with \—>j<n(n) as its n-th figure. Since β is computable, there exists a number K such that 1-фn(n)=фK(n) all n. Putting n=K, we have 1=2фK(K), i.e. 1 is even. This is impossible. The computable sequences are therefore not enumerable”.

The fallacy in this argument lies in the assumption that β is computable. It would be true if we could enumerate the computable sequences by finite means, but the problem of enumerating computable sequences is equivalent to the problem of finding out whether a given number is the D.N of a circle-free machine, and we have no general process for doing this in a finite number of steps. In fact, by applying the diagonal process argument correctly, we can show that there cannot be any such general process.

The simplest and most direct proof of this is by showing that, if this general process exists, then there is a machine which computes β. This proof, although perfectly sound, has the disadvantage that it may leave the reader with a feeling that “there must be something wrong”. The proof which I shall give has not this disadvantage, and gives a certain insight into the significance of the idea “circle-free”. It depends not on constructing β, but on constructing β′, whose n-th figure is фn(n).

Let us suppose that there is such a process; that is to say, that we can invent a machine 𝒟 which, when supplied with the S.D of any computing machine ℳ will test this S.D and if ℳ is circular will mark the S.D with the symbol “u” and if it is circle-free will mark it with “s” . By combining the machines 𝒟 and 𝒰 we could construct a machine ℳ to compute the sequence β′. The machine 𝒟 may require a tape. We may suppose that it uses the E-squares beyond all symbols on F-squares, and that when it has reached its verdict all the rough work done by 𝒟 is erased.

The machine ℳ has its motion divided into sections. In the first N-1 sections, among other things, the integers 1, 2,…, N-1 have been written down and tested by the machine 𝒟. A certain number, say R(N-I), of them have been found to be the D.N's of circle-free machines. In the N-th section the machine 𝒟 tests the number N. If N is satisfactory, i.e., if it is the D.N of a circle-free machine, then R(N)=1+R(N-1) and the first R(N) figures of the sequence of which a D.N is N are calculated. The R(N)-th figure of this sequence is written down as one of the figures of the sequence β′ computed by ℳ. If N is not satisfactory, then R(N)=R(N-1) and the machine goes on to the (N+l)-th section of its motion.

From the construction of ℳ we can see that ℳ is circle-free. Each section of the motion of ℳ comes to an end after a finite number of steps. For, by our assumption about 𝒟, the decision as to whether N is satisfactory is reached in a finite number of steps. If N is not satisfactory, then the N-th section is finished. If N is satisfactory, this means that the machine ℳ(N) whose D.N is N is circle-free, and therefore its R(N)-th figure can be calculated in a finite number of steps. When this figure has been calculated and written down as the R(N)-th figure of β′, the N-th section is finished. Hence ℳ is circle-free.

Now let K be the D.N of ℳ. What does ℳ do in the K-th section of its motion? It must test whether K is satisfactory, giving a verdict “s” or “u”. Since K is the D.N of ℳ and since ℳ is circle-free, the verdict cannot be “u”. On the other hand the verdict cannot be “s”. For if it were, then in the K-th. section of its motion ℳ would be bound to compute the first R(K-1)+1=R(K) figures of the sequence computed by the machine with K as its D.N and to write down the R(K)-th as a figure of the sequence computed by ℳ. The computation of the first R(K)-1 figures would be carried out all right, but the instructions for calculating the R(K)-th would amount to “calculate the first R(K) figures computed by H and write down the R(K)-th”. This R(K)-th figure would never be found. I.e., ℳ is circular, contrary both to what we have found in the last paragraph and to the verdict “s”. Thus both verdicts are impossible and we conclude that there can be no machine 𝒟

We can show further that there can be no machine ℰ which, when supplied with the S.D of an arbitrary machine ℳ, will determine whether ℳ ever prints a given symbol (0 say).

We will first show that, if there is a machine ℰ then there is a general process for determining whether a given machine ℳ prints 0 infinitely often. Let ℳ1 be a machine which prints the same sequence as ℳ, except that in the position where the first 0 printed by ℳ stands, ℳ1 prints 0. ℳ2 is to have the first two symbols 0 replaced by 0, and so on. Thus, if ℳ were to print

ABAQlAABOQIOAB…,

then ℳ1 would print

ABA01AAB0010AB…

and ℳ2 would print

ABA01AAB0010AB….

Now let ℱ be a machine which, when supplied with the S.D of ℳ, will write down successively the S.D of ℳ, of ℳ1 of ℳ2, … (there is such a machine). We combine ℱ with ℰ and obtain a new machine, 𝒢. In the motion of 𝒢 first ℱ is used to write down the S.D of ℳ, and then ℰ tests it. :o: is written if it is found that ℳ never prints 0; then ℱ writes the S.D of ℳ1, and this is tested, :0: being printed if and only if ℳ1 never prints 0, and so on. Now let us test 𝒢 with ℰ. If it is found that 𝒢 never prints 0, then ℳ prints 0 infinitely often; if 𝒢 prints 0 sometimes, then ℳ does not print 0 infinitely often.

Similarly there is a general process for determining whether ℳ prints 1 infinitely often. By a combination of these processes we have a process for determining whether ℳ prints an infinity of figures, i.e. we have a process for determining whether ℳ is circle-free. There can therefore be no machine ℰ.

The expression “there is a general process for determining…” has been used throughout this section as equivalent to “there is a machine which will determine …”. This usage can be justified if and only if we can justify our definition of “computable”. For each of these “general process” problems can be expressed as a problem concerning a general process for determining whether a given integer n has a property G(n) [e.g. G(n) might mean “n is satisfactory” or “n is the Gödel representation of a provable formula”], and this is equivalent to computing a number whose n-th figure is 1 if G(n) is true and 0 if it is false.

9. The extent of the computable numbers.

No attempt has yet been made to show that the “computable” numbers include all numbers which would naturally be regarded as computable. All arguments which can be given are bound to be, fundamentally, appeals to intuition, and for this reason rather unsatisfactory mathematically. The real 𝔮uestion at issue is “What are the possible processes which can be carried out in computing a number?”

The arguments which I shall use are of three kinds.

  1. (a) A direct appeal to intuition.
  2. (b) A proof of the equivalence of two definitions (in case the new definition has a greater intuitive appeal).
  3. (c) Giving examples of large classes of numbers which are computable.

Once it is granted that computable numbers are all “computable”, several other propositions of the same character follow. In particular, it follows that, if there is a general process for determining whether a formula of the Hilbert function calculus is provable, then the determination can bo carried out by a machine.

I. [Type (a)]. This argument is only an elaboration of the ideas of §1.

Computing is normally done by writing certain symbols on paper. We may suppose this paper is divided into squares like a child's arithmetic book. In elementary arithmetic the two-dimensional character of the paper is sometimes used. But such a use is always avoidable, and I think that it will be agreed that the two-dimensional character of paper is no essential of computation. I assume then that the computation is carried out on one-dimensional paper, i.e. on a tape divided into squares. I shall also suppose that the number of symbols which may be printed is finite. If we were to allow an infinity of symbols, then there would be symbols differing to an arbitrarily small extent †. The effect of this restriction of the number of symbols is not very serious. It is always possible to use sequences of symbols in the place of single symbols. Thus an Arabic numeral such as

17 or 999999999999999 is normally treated as a single symbol. Similarly in any European language words are treated as single symbols (Chinese, however, attempts to have an enumerable infinity of symbols). The differences from our point of view between the single and compound symbols is that the compound symbols, if they are too lengthy, cannot be observed at one glance. This is in accordance with experience. We cannot tell at a glance whether 9999999999999999 and 999999999999999 are the same.

The behaviour of the computer at any moment is determined by the symbols which he is observing, and his “state of mind” at that moment. We may suppose that there is a bound B to the number of symbols or squares which the computer can observe at one moment. If he wishes to observe more, he must use successive observations. We will also suppose that the number of states of mind which need be taken into account is finite. The reasons for this are of the same character as those which restrict the number of symbols. If we admitted an infinity of states of mind, some of them will be “arbitrarily close” and will be confused. Again, the restriction is not one which seriously affects computation, since the use of more complicated states of mind can be avoided by writing more symbols on the tape.

Let us imagine the operations performed by the computer to be split up into “simple operations” which are so elementary that it is not easy to imagine them further divided. Every such operation consists of some change of the physical system consisting of the computer and his tape. We know the state of the system if we know the sequence of symbols on the tape, which of these are observed by the computer (possibly with a special order), and the state of mind of the computer. We may suppose that in a simple operation not more than one symbol is altered. Any other changes can be split up into simple changes of this kind. The situation in regard to the squares whose symbols may be altered in this way is the same as in regard to the observed squares. We may, therefore, without loss of generality, assume that the squares whose symbols are changed are always “observed” squares.

Besides these changes of symbols, the simple operations must include changes of distribution of observed squares. The new observed squares must be immediately recognisable by the computer. I think it is reasonable to suppose that they can only be squares whose distance from the closest of the immediately previously observed squares does not exceed a certain fixed amount. Let us say that each of the new observed squares is within L squares of an immediately previously observed square.

In connection with “immediate recognisability” , it may be thought that there are other kinds of square which are immediately recognisable. In particular, squares marked by special symbols might be taken as immediately recognisable. Now if these squares are marked only by single symbols there can be only a finite number of them, and we should not upset our theory by adjoining these marked squares to the observed squares. If, on the other hand, they are marked by a sequence of symbols, we cannot regard the process of recognition as a simple process. This is a fundamental point and should be illustrated. In most mathematical papers the equations and theorems are numbered. Normally the numbers do not go beyond (say) 1000. It is, therefore, possible to recognise a theorem at a glance by its number. But if the paper was very long, we might reach Theorem 157767733443477; then, further on in the paper, we might find “… hence (applying Theorem 157767733443477) we have …”. In order to make sure which was the relevant theorem we should have to compare the two numbers figure by figure, possibly ticking the figures off in pencil to make sure of their not being counted twice. If in spite of this it is still thought that there are other “immediately recognisable” squares, it does not upset my contention so long as these squares can be found by some process of which my type of machine is capable. This idea is developed in III below.

The simple operations must therefore include:

  1. (a) Changes of the symbol on one of the observed squares.
  2. (b) Changes of one of the squares observed to another square within L squares of one of the previously observed squares.

It may be that some of these changes necessarily involve a change of state of mind. The most general single operation must therefore be taken to be one of the following:

  1. (A) A possible change (a) of symbol together with a possible change of state of mind.
  2. (B) A possible change (b) of observed squares, together with a possible change of state of mind.

The operation actually performed is determined, as has been suggested on p. 250, by the state of mind of the computer and the observed symbols. In particular, they determine the state of mind of the computer after the operation is carried out.

We may now construct a machine to do the work of this computer. To each state of mind of the computer corresponds an “m-configuration” of the machine. The machine scans B squares corresponding to the B squares observed by the computer. In any move the machine can change a symbol on a scanned square or can change any one of the scanned squares to another square distant not more than L squares from one of the other scanned squares. The move which is done, and the succeeding configuration, are determined by the scanned symbol and the m-configuration. The machines just described do not differ very essentially from computing machines as defined in §2, and corresponding to any machine of this type a computing machine can be constructed to compute the same sequence, that is to say the sequence computed by the computer.

II. [Type (6)].

If the notation of the Hilbert functional calculus† is modified so as to be systematic, and so as to involve onty a finite number of symbols, it becomes possible to construct an automatic‡ machine 𝒦, which will find all the provable formulae of the calculus§.

Now let α be a sequence, and let us denote by Gα(x) the proposition “The x-th figure of α is 1”, so that||Gα(x) means “The x-th figure of α is 0”. Suppose further that we can find a set of properties which define the sequence α and which can be expressed in terms of Gα(x) and of the prepositional functions N(x) meaning “x is a non-negative integer” and F(x, y) meaning “y=x+1”. When we join all these formulae together conjunctively, we shall have a formula, 𝔘 say, which defines α. The terms of 𝔘 must include the necessary parts of the Peano axioms, viz.,

(∃u)N(u)&(x) (N(x)→(∃y)F(x, y)) & (F(x, y)→N(y)),

which we will abbreviate to P.

When we say “𝔘 defines α”, we mean that —𝔘 is not a provable formula, and also that, for each n, one of the following formulae (An) or (Bn) is provable.

			𝔘 & F(n)Gα(u(n)),             (An)¶
			𝔘 & F(n)→ (—Gα(u(n))),             (Bn),
		

where F(n) stands for F(u, u′) & F(u′, u′′) & … F(u(n-1), u(n)).


I say that α is then a computable sequence: a machine 𝓀α to compute α can be obtained by a fairly simple modification of 𝒦.

We divide the motion of 𝓀α into sections. The n-th section is devoted to finding the n-th figure of α. After the (n-1)-th section is finished a double colon :: is printed after all the symbols, and the succeeding work is done wholly on the squares to the right of this double colon. The first step is to write the letter “A” followed by the formula (An) and then “B” followed by (Bn). The machine 𝒦α then starts to do the work of 𝒦, but whenever a provable formula is found, this formula is compared with (An) and with (Bn). If it is the same formula as (An), then the figure “1” is printed, and the n-th. section is finished. If it is (Bn) then “0” is printed and the section is finished. If it is different from both, then the work of 𝒦 is continued from the point at which it had been abandoned. Sooner or later one ofthe formulae (An) or (Bn) is reached; this follows from our hypotheses about α and 𝔘, and the known nature of 𝒦. Hence the n-th section will eventually be finished. 𝓀α is circle-free; α is computable.

It can also be shown that the numbers α definable in this way by the use of axioms include all the computable numbers. This is done by describing computing machines in terms of the function calculus.

It must be remembered that we have attached rather a special meaning to the phrase “𝔘 defines α”. The computable numbers do not include all. (in the ordinary sense) definable numbers. Let δ be a sequence whose n-th figure is 1 or 0 according as n is or is not satisfactory. It is an immediate consequence of the theorem of §8 that δ is not computable. It is (so far as we know at present) possible that any assigned number of figures of δ can be calculated, but not by a uniform process. When sufficiently many figures of δ have been calculated, an essentially new method is necessary in order to obtain more figures.

III. This may be regarded as a modification of I or as a corollary of II.

We suppose, as in I, that the computation is carried out on a tape; but we avoid introducing the “state of mind” by considering a more physical and definite counterpart of it. It is always possible for the computer to break off from his work, to go away and forget all about it, and later to come back and go on with it. If he does this he must leave a note of instructions (written in some standard form) explaining how the work is to be continued. This note is the counterpart of the “state of mind”. We will suppose that the computer works in such a desultory manner that he never does more than one step at a sitting. The note of instructions must enable him to carry out one step and write the next note. Thus the state of progress of the computation at any stage is completely determined by the note of instructions and the symbols on the tape. That is, the state of the system may be described by a single expression (sequence of symbols), consisting of the symbols on the tape followed by Δ (which we suppose not to appear elsewhere) and then by the note of instructions. This expression may be called the “state formula”. We know that the state formula at any given stage is determined by the state formula before the last step was made, and we assume that the relation of these two formulae is expressible in the functional calculus. In other words, we assume that there is an axiom 𝔘 which expresses the rules governing the behaviour of the computer, in terms of the relation of the state formula at any stage to the state formula at the preceding stage. If this is so, we can construct a machine to write down the successive state formulae, and hence to compute the required number.

10. Examples of large classes of numbers which are computable.

It will be useful to begin with definitions of a computable function of an integral variable and of a computable variable, etc. There are many equivalent ways of defining a computable function of an integral variable. The simplest is, possibly, as follows. If γ is a computable sequence in which 0 appears infinitely† often, and n is an integer, then let us define ε(γ, n) to be the number of figures 1 between the n-th and the (n+1)-th figure 0 in γ. Then ф(n) is computable if, for all n and some γ, ф(n) = ε(γ, n). An equivalent definition is this. Let H(x, y) mean ф(x)=y. Then, if we can find a contradiction-free axiom 𝔘ф, such that 𝔘фP, and if for each integer n there exists an integer N, such that

𝔘ф & F(N)H(u(n), u(ф(n))),

and such that, if m≠ф(n), then, for some N′,

𝔘ф & F(N′) → (—H(u(n), u(m)),

then ф may be said to be a computable function.

We cannot define general computable functions of a real variable, since there is no general method of describing a real number, but we can define a computable function of a computable variable. If n is satisfactory, let γn be the number computed by ℳ(n), and let


			
			

unless γn=0 or γn=1, in either of which cases αn=0. Then, as n runs through the satisfactory numbers, αn runs through the computable numbers†. Now let ф(n) be a computable function which can be shown to be such that for any satisfactory argument its value is satisfactory ‡. Then the function f, defined by fn)= αф(n), is a computable function and all computable functions of a computable variable are expressible in this form.

Similar definitions may be given of computable functions of several variables, computable-valued functions of an integral variable, etc.

I shall enunciate a number of theorems about computability, but I shall prove only (ii) and a theorem similar to (iii).

  1. (i) A computable function of a computable function of an integral or computable variable is computable.
  2. (ii) Any function of an integral variable defined recursively in terms of computable functions is computable. I.e. if ф(m, n) is computable, and r is some integer, then ƞ(n) is computable, where
  3. ƞ(0)=r,
    ƞ(n)=ф(n, ƞ(n-1)).
  4. (iii) If ф(m, n) is a computable function of two integral variables, then ф(n, n) is a computable function of n.
  5. (iv) If ф(n) is a computable function whose value is always 0 or 1, then the sequence whose n-th figure is ф(n) is computable.

    Dedekind's theorem does not hold in the ordinary form if we replace “real” throughout by “computable”. But it holds in the following form:

  6. (v) If G(α) is a propositional function of the computable numbers and
(a) (∃α)(∃β){G(α) & (—G(β))},
(6) G(α) & (—G(β))→(α<β),

and there is a general process for determining the truth value of G(α), then


there is a computable number ε such that

G(α)→α≤ε,
G(α)→α≥ε,

In other words, the theorem holds for any section of the computables such that there is a general process for determining to which class a given number belongs.

Owing to this restriction of Dedekind's theorem, we cannot say that a computable bounded increasing sequence of computable numbers has a computable limit. This may possibly be understood by considering a sequence such as

–1, –1⁄2, –1⁄4, –1⁄8, –1⁄16, 1⁄2, ….

On the other hand, (v) enables us to prove

(vi) If α and β are computable and α < β and ф(α) < 0 < ф(β), where ф(α) is a computable increasing continuous function, then there is a unique computable number γ, satisfying α < γ < β and ф(γ) = 0.

Computable convergence.

We shall say that a sequence βn of computable numbers converges computably if there is a computable integral valued function N(ε) of the computable variable ε, such that we can show that, if ε > 0 and n > N(ε) and m > N(ε), then |βn–βm|<ε.

We can then show that

(vii) A power series whose coefficients form a computable sequence of computable numbers is computably convergent at all computable points in the interior of its interval of convergence.

(viii) The limit of a computably convergent sequence is computable. And with the obvious definition of “uniformly computably convergent”:

(ix) The limit of a uniformly computably convergent computable sequence of computable functions is a computable function. Hence

(x) The sum of a power series whose coefficients form a computable sequence is a computable function in the interior of its interval of convergence.

From (viii) and π=4(1–1⁄3+1⁄5–…) we deduce that π is computable.

From e=1+1+1⁄2!+1⁄3!… we deduce that e is computable.

From (vi) we deduce that all real algebraic numbers are computable.

From (vi) and (x) we deduce that the real zeros of the Bessel functions are computable.

Proof of (ii).

Let H(x, y) mean “ƞ(x)=y”, and let K(x, y, z) mean “ф(x, y)=z”. 𝔘ф is the axiom for ф(x, y). We take 𝔘ƞ, to be

𝔘ф&P&(F(x, y)→G(x, y))&(G(x, y) & G(y, z)→G(x, z)) &(Fr)→ H(u, ur)) &(F(v, w) & H(v, x) & K(w, x, z) → H(w, z)) &[H(w, z) & G(z, t) v G(t, z) →(–H(w, t))].

I shall not give the proof of consistency of 𝔘ƞ. Such a proof may be constructed by the methods used in Hilbert and Bernays, Grundlagen der Mathematik (Berlin, 1934), p. 209 et seq. The consistency is also clear from the meaning.

Suppose that, for some n, N, we have shown

𝔘ƞ & F(N)H(u(n-1), u(ƞ(n-1))),

then, for some M,

𝔘ф & F(M)K(u(n), u(ƞ(n-1)), uƞ(n))),
𝔘ƞ & F(M)F(u(n-1), u(n-1)) & H(u(n-1), u(ƞ(n)))
& K(u(n), u(ƞ(n-1)), u(ƞ(n))),

and

𝔘ƞ & F(M) → [F(u(n-1), u(n)) & H(u(n-1), u(ƞ(n-1)))
& K(u(n), u(ƞ(n-1)), u(ƞ(n))) → H(u(n), u(ƞ(n)))].

Hence 𝔘ƞ & F(M)H(u(n), u(ƞ(n))).

Also 𝔘ƞ & F(r)H(u, u(ƞ(0))).

Hence for each n some formula of the form

𝔘ƞ & F(M)H(un, u(ƞ(n)))

is provable. Also, if M′≥M and M′≥m and m≠ƞ(u), then

𝔘ƞ & F(M′)G(uƞ((n)), u(m)) ν G(u(m), u(ƞ(n)))

and

𝔘ƞ & F(M′) → [{G(u(ƞ(n)), u(m)) ν G(u(m), u(ƞ(n))
& H(u(n), u(ƞ(n))} → (–H(u(n), u(n)))].

Hence

𝔘ƞ & F(M′) → (–H(u(n), u(n)))

The conditions of our second definition of a computable function are therefore satisfied. Consequently ƞ is a computable function.

Proof of a modified form of (iii).

Suppose that we are given a machine 𝒩, which, starting with a tape bearing on it ə ə followed by a sequence of any number of letters “F” on F-squares and in the m-configuration b, will compute a sequence γn depending on the number n of letters “F”. If фn(m) is the m-th figure of γn, then the sequence β whose n-th figure is фn(n) is computable.

We suppose that the table for 𝒩 has been written out in such a way that in each line only one operation appears in the operations column. We also suppose that Ξ, Θ, 0, and 1 do not occur in the table, and we replace ə throughout by Θ, 0 by 0, and 1 by 1. Further substitutions are then made. Any line of form

𝔘 α P0 𝔅

we replace by

𝔘 α P0 𝔯𝔢(𝔅, 𝔲, h, k)

and any line of the form

𝔘 α P1 𝔅

by 𝔘 α P1 𝔯𝔢(𝔅, 𝔲, h, k)

and we add to the table the following lines

𝔲 𝔭𝔢(𝔲1, 0)
𝔲1 R, Pk, R, PΘ, R, PΘ 𝔲2
𝔲2 𝔯𝔢(𝔲3, 𝔲3, k, h)
𝔲3 𝔭𝔢(𝔲2, F)

and similar lines with 𝔬 for 𝔲 and 1 for 0 together with the following line

𝔠 R, PΞ, R, Ph 𝔟

We then have the table for the machine 𝒩′ which computes β. The initial m-configuration is 𝔠, and the initial scanned symbol is the second ə.

11. Application to the Entscheidungsproblem.

The results of §8 have some important applications. In particular, they can be used to show that the Hilbert Entscheidungsproblem can have no solution. For the present I shall confine myself to proving this particular theorem. For the formulation of this problem I must refer the reader to Hilbert and Ackermann's Grundzüge der Theoretischen Logik (Berlin, 1931), chapter 3.

I propose, therefore, to show that there can be no general process for determining whether a given formula 𝔘 of the functional calculus K is provable, i.e. that there can be no machine which, supplied with any one 𝔘 of these formulae, will eventually say whether 𝔘 is provable.

It should perhaps be remarked that what I shall prove is 𝔮uite different from the well-known results of Gödel†. Gödel has shown that (in the formalism of Principia Mathematica) there are propositions 𝔘 such that neither 𝔘 nor – 𝔘 is provable. As a consequence of this, it is shown that no proof of consistency of Principia Mathematica (or of K) can be given within that formalism. On the other hand, I shall show that there is no general method which tells whether a given formula 𝔘 is provable in K, or, what comes to the same, whether the system consisting of K with –𝔘 adjoined as an extra axiom is consistent.

If the negation of what Gödel has shown had been proved, i.e. if, for each 𝔘, either 𝔘 or –𝔘 is provable, then we should have an immediate solution of the Entscheidungsproblem. For we can invent a machine 𝒦 which will prove consecutively all provable formulae. Sooner or later 𝒦 will reach either 𝔘 or –𝔘. If it reaches 𝔘, then we know that 𝒰 is provable. If it reaches –𝔘, then, since K is consistent (Hilbert and Ackermann, p. 65), we know that 𝔘 is not provable.

Owing to the absence of integers in K the proofs appear somewhat lengthy. The underlying ideas are 𝔮uite straightforward.

Corresponding to each computing machine ℳ we construct a formula Un(ℳ) and we show that, if there is a general method for determining whether Un(ℳ) is provable, then there is a general method for determining whether ℳ ever prints 0.

The interpretations of the propositional functions involved are as follows:

Rs1(x, y) to be interpreted as “in the complete configuration x (of ℳ) the symbol on the square y is S”.


I(x, y) is to be interpreted as “in the complete configuration x the square y is scanned”.

Kqm(x) is to be interpreted as “in the complete configuration x the m-configuration is qm.

F(x, y) is to be interpreted as “y is the immediate successor of x”.

Inst{qiSjSkLql} is to be an abbreviation for

(x, y, x′, y′) { (RSj(x, y) & I(x, y) & Kqi(x) & F(x, x′) & F(y′, y))
→(I(x′, y′) & RSk(x′, y) & Kql(x′)
& (z) [F(y′, z) v (RSj(x′, z))])};
Inst {qiSjSkRql} and Inst {qiSjSkNql}

are to be abbreviations for other similarly constructed expressions.

Let us put the description of ℳ into the first standard form of §6. This description consists of a number of expressions such as qiSjSkLql” (or with R or N substituted for L). Let us form all the corresponding expressions such as Inst {qiSjSkLql} and take their logical sum. This we call Des(ℳ).

The formula Un(ℳ) is to be

(∃u)[N(u) & (x)(N(x) → (∃x′) F(x, x′))
& (y, z)(F(y, z) → N(y) & N(z)) & (y) RSo(u, y)
& U(u, u) & Kql(u) & Des(ℳ)]
→(∃s)(∃t)[N(s) & N(t) & RSl(s, t)].
N(u) & … & Des(ℳ)] may be abbreviated to A(ℳ)

When we substitute the meanings suggested on p. 259-60 we find that Un(ℳ) has the interpretation “in some complete configuration of ℳ, S1 (i.e. 0) appears on the tape”. Corresponding to this I prove that

(a) If S1 appears on the tape in some complete configuration of ℳ, then Un(ℳ) is provable.

(b) If Un(ℳ) is provable, then S1 appears on the tape in some complete configuration of ℳ.

When this has been done, the remainder of the theorem is trivial.


LEMMA 1. If S1 appears on the tape in some complete configuration of ℳ, then Un(ℳ) is provable.

We have to show how to prove Un(ℳ). Let us suppose that in the n-th complete configuration the sequence of symbols on the tape is Sr(n,0),Sr(n,1), …, Sr(n,n), followed by nothing but blanks, and that the scanned symbol is the i(n)-th, and that the m-configuration is qk(n). Then we may form the proposition

which we may abbreviate to CCn.

As before, F(u, u′) & F(u′, u′′) & … & F(u(r-1), u(r)) is abbreviated to F(r).

I shall show that all formulae of the form A(ℳ) & F(n)CCn (abbreviated to CFn) are provable. The meaning of CFn is “The n-th complete configuration of ℳ is so and so” , where “so and so” stands for the actual n-th complete configuration of it. That CFn should be provable is therefore to be expected.

CF0 is certainly provable, for in the complete configuration the symbols are all blanks, the m-configuration is q1, and the scanned square is u, i.e. CC0 is

(y) RS0(u, y) & I(u, u) & Kq1(u).

A(ℳ) → CC0 is then trivial.

We next show that CFnCFn+1 is provable for each n. There are three cases to consider, according as in the move from the n-th to the (n+l)-th configuration the machine moves to left or to right or remains stationary. We suppose that the first case applies, i.e. the machine moves to the left. A similar argument applies in the other cases. If r(n,i(n))=α, r(n+1, i(n+1))=c, k(i(n))=b, and k(i(n+1))=d, then Des(ℳ) must include Inst {qaSbSdLqc} as one of its terms, i.e.

Des(ℳ) → Inst {qaSbSdLqc}.

Hence A(ℳ) & F(n+1) → Inst {qaSbSdLqc} & F(n+1).

But Inst {qaSbSdLqc} & F(n+1) → (CCnCCn+1)

is provable, and so therefore is

A(ℳ) & F(n+1) → (CCnCCn+1)

and (A(ℳ) &F(n)CCn) → (A(ℳ) & F(n+1)CCn+1),

i.e. CFnCFn+1

CFnis provable for each n. Now it is the assumption of this lemma that S1 appears somewhere, in some complete configuration, in the sequence of symbols printed by ℳ; that is, for some integers N, K, CCN has RSl(u(N), u(K)) as one of its terms, and therefore CCNRSl(u(N), u(K)) is provable. We have then

CCNRSl(u(N), u(K))

and A(ℳ) & F(N)CCN.

We also have

(∃u) A(ℳ) → (∃u)(∃u′) … (∃u (N′))(A(ℳ) & F(N)),

where N&prime = max(N, K). And so

(∃u) A(ℳ) → (∃u)(∃u′) … (∃u (N′))RS1(u(N), u(K)),
(∃u) A(ℳ) → (∃u(N))(∃u(K))RS1(u(N), u(K)),
(∃u) A(ℳ) → (∃s)(∃t)RS1(s, t),

i.e. Un(ℳ) is provable.

This completes the proof of Lemma 1.

LEMMA 2. If Un(ℳ) is provable, then S1 appears on the tape in some complete configuration of ℳ.

If we substitute any propositional functions for function variables in a provable formula, we obtain a true proposition. In particular, if we substitute the meanings tabulated on pp. 259-260 in Un(ℳ), we obtain a true proposition with the meaning “S1 appears somewhere on the tape in some complete configuration of ℳ”.

We are now in a position to show that the Entscheidungsproblem cannot be solved. Let us suppose the contrary. Then there is a general (mechanical) process for determining whether Un(ℳ) is provable. By Lemmas 1 and 2, this implies that there is a process for determining whether ℳ ever prints 0, and this is impossible, by §8. Hence the Entscheidungsproblem cannot be solved.

In view of the large number of particular cases of solutions of the Entscheidungsproblem for formulae with restricted systems of quantors, it


is interesting to express Un(ℳ) in a form in which all quantors are at the beginning. Un(ℳ) is, in fact, expressible in the form

(u)(∃x)(w)(∃u1) … (∃un)𝔅, (I)

where 𝔅 contains no quantors, and n=6. By unimportant modifications we can obtain a formula, with all essential properties of Un(ℳ), which is of form (I) with n=5.

Added 28 August, 1936.

APPENDIX.

Computabiliiy and effective calculability

The theorem that all effectively calculable (λ-definable) sequences are computable and its converse are proved below in outline. It is assumed, that the terms “well-formed formula” (W.F.F.) and “conversion” as used by Church and Kleene are understood. In the second of these proofs the existence of several formulae is assumed without proof; these formulae may be constructed straightforwardly with the help of, e.g., the results of Kleene in “A theory of positive integers in formal logic”, American Journal of Math., 57 (1935), 153-173, 219-244.

The W.F.F. representing an integer n will be denoted by Nn. We shall say that a sequence γ whose n-th figure is фγ(n) is λ-definable or effectively calculable if 1+фγ(n) is a λ-definable function of n, i.e. if there is a W.F.F. Mγ such that, for all integers n,

{Mγ}{Nγ} conv Nфγ(n)+1,

i.e.{Mγ}{Nγ} is convertible into λxy.x(x(y)) or into λxy.x(y) according as the n-th figure of λ is 1 or 0.

To show that every λ-definable sequence γ is computable, we have to show how to construct a machine to compute γ. For use with machines it is convenient to make a trivial modification in the calculus of conversion. This alteration consists in using x, x′, x′′, … as variables instead of a, b, c, …. We now construct a machine ℒ which, when supplied with the formula Mγ, writes down the sequence γ. The construction of ℒ is somewhat similar to that of the machine 𝒦 which proves all provable formulae of the functional calculus. We first construct a choice machine ℒ1 which, if supplied with a W.F.F., M say, and suitably manipulated, obtains any formula into which M is convertible. ℒ1 can then be modified so as to yield an automatic machine ℒ2 which obtains successively all the formulae into which M is convertible (cf. foot-note p. 252). The machine ℒ includes ℒ2 as a part. The motion of the machine ℒ when supplied with the formula Mγ is divided into sections of which the n-th is devoted to finding the n-th figure of γ. The first stage in this n-th section is the formation of {Mγ}(Nn). This formula is then supplied to the machine ℒ2, which converts it successively into various other formulae. Each formula into which it is convertible eventually appears, and each, as it is found, is compared with

λxx′[{x}({x}(x′))]], i.e. N2,

and with λxx′[{x}(x′)]], i.e. N1

If it is identical with the first of these, then the machine prints the figure 1 and the n-th section is finished. If it is identical with the second, then 0 is printed and the section is finished. If it is different from both, then the work of ℒ2 is resumed. By hypothesis, {Mγ}(Nn) is convertible into one of the formulae N2 or N1; consequently the n-th section will eventually be finished, i.e. the n-th figure of γ will eventually be written down.

To prove that every computable sequence γ is λ-definable, we must show how to find a formula Mγ such that, for all integers n,

{Mγ}(Nn) conv N1+фγ(n)

Let ℳ be a machine which computes γ and let us take some description of the complete configurations of ℳ by means of numbers, e.g. we may take the D.N of the complete configuration as described in §6. Let ε(n) be the D.N of the n-th complete configuration of ℳ. The table for the machine ℳ gives us a relation between ε(n+1) and ε(b) of the form

ε(n+1)=ργ(ε(n)),

where ργ is a function of very restricted, although not usually very simple, form: it is determined by the table for ℳ. ργ is λ-definable (I omit the proof of this), i.e. there is a W.F.F. Aγ such that, for all integers n,

{Aγ} (Nε(n)).

Let U stand for

λu[{ {u}(Aγ)}(Nr)],

where r=ε(0); then, for all integers n,

{Uγ}(Nn) conv Nε(n).

It may be proved that there is a formula V such that

conv Nx if, in going from the n-th to the (n-\- l)-th complete configuration, the figure 0 is printed. conv JV2 if the figure 1 is printed, conv N3 otherwise.

Let Wγ stand for

λu[{ {V}({Aγ}({Uγ}(u)))}({Uγ}(u))].

so that, for each integer n,

{ {V}(Nε(n+1))}(Nε(n+1)) conv {Wγ}(Nn).

and let Q be a formula such that

{ {Q}(Wγ)}(NS) conv Nr(ε),

where r(s) is the s-th integer q for which {Wγ}(Nq) is convertible into either N1 or B2. Then, if M stands for

λw[{Wγ}({ {Q}(Wγ)}(w))],

it will have the required property†.

The Graduate College,

Princeton University,

New Jersey, U.S.A.

† In a complete proof of the λ-definability of computable sequences it would be best to modify this method by replacing the numerical description of the complete configurations by a description which can be handled more easily with our apparatus. Let us choose certain integers to represent the symbols and the m-configurations of the machine. Suppose that in a certain complete configuration the numbers representing the successive symbols on the tape are s1s2sn, that the m-th symbol is scanned, and that the m-configuration has the number t; then we may represent this complete configuration by the formula

[[Ns1, Ns2, …,Nsm-1], [Nt, Nsm], [Nsm+1,…, Nsn]],

where [a, b] stands for λu[{ {u}{a} }(b)],

[a, b, c] stands for λu[{ {u}(a)}(b)}(c)],

etc.