src/HOL/Lex/README.html
author paulson
Mon, 02 Feb 1998 12:55:39 +0100
changeset 4593 6fc8f224655f
parent 4137 2ce2e659c2b1
child 4931 2ec84dee7911
permissions -rw-r--r--
Three new facts about Image
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
3279
815ef5848324 tuned all READMEs;
wenzelm
parents: 1345
diff changeset
     1
<HTML><HEAD><TITLE>HOL/Lex/README</TITLE></HEAD>
1344
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
     2
<BODY>
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
     3
1345
d4e26f632bca Better!
nipkow
parents: 1344
diff changeset
     4
<H1>A Simplified Scanner Generator</H1>
1344
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
     5
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
     6
This is half of a simplified functional scanner generator. The overall design
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
     7
is like this:
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
     8
<PRE>
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
     9
         regular expression
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    10
                  |
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    11
                  v
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    12
             -----------
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    13
             | mk_auto |
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    14
             -----------
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    15
                  |
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    16
        deterministic automaton
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    17
                  |
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    18
                  v
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    19
           ----------------
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    20
string --> | auto_chopper | --> chopped up string
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    21
           ----------------
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    22
</PRE>
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    23
A chopped up string is a pair of
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    24
<UL>
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    25
<LI>a prefix of the input string, chopped up into words of the language,
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    26
<LI>together with the remaining suffix.
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    27
</UL>
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    28
For example, if the language consists just of the word <KBD>ab</KBD>, the
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    29
input <KBD>ababaab</KBD> is partitioned into a chopped up prefix
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    30
<KBD>[ab,ab]</KBD> and the suffix <KBD>aab</KBD>.
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    31
<P>
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    32
4137
2ce2e659c2b1 Added an alternativ version of AutoChopper and a theory for the conversion of
nipkow
parents: 3279
diff changeset
    33
The auto_chopper is implemented in theory AutoChopper. An alternative (more
2ce2e659c2b1 Added an alternativ version of AutoChopper and a theory for the conversion of
nipkow
parents: 3279
diff changeset
    34
efficient) version is defined in AutoChopper1. However, no properties have
2ce2e659c2b1 Added an alternativ version of AutoChopper and a theory for the conversion of
nipkow
parents: 3279
diff changeset
    35
been proved for it yet.
1344
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    36
4137
2ce2e659c2b1 Added an alternativ version of AutoChopper and a theory for the conversion of
nipkow
parents: 3279
diff changeset
    37
The top part of the diagram, i.e. the translation of regular expressions into
2ce2e659c2b1 Added an alternativ version of AutoChopper and a theory for the conversion of
nipkow
parents: 3279
diff changeset
    38
deterministic finite automata is still missing (although we have some bits
2ce2e659c2b1 Added an alternativ version of AutoChopper and a theory for the conversion of
nipkow
parents: 3279
diff changeset
    39
and pieces).
2ce2e659c2b1 Added an alternativ version of AutoChopper and a theory for the conversion of
nipkow
parents: 3279
diff changeset
    40
<P>
2ce2e659c2b1 Added an alternativ version of AutoChopper and a theory for the conversion of
nipkow
parents: 3279
diff changeset
    41
2ce2e659c2b1 Added an alternativ version of AutoChopper and a theory for the conversion of
nipkow
parents: 3279
diff changeset
    42
The directory also contains Regset_of_auto, a theory describing the
2ce2e659c2b1 Added an alternativ version of AutoChopper and a theory for the conversion of
nipkow
parents: 3279
diff changeset
    43
translation of deterministic automata into regular sets.
1344
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    44
</BODY>
f172a7f14e49 Half a lexical analyzer generator.
nipkow
parents:
diff changeset
    45
</HTML>