author | wenzelm |
Tue, 05 Dec 2017 16:03:58 +0100 | |
changeset 67140 | 386a31d6d17a |
parent 66993 | 2c2a346cfe70 |
child 67605 | 3dd0dfe04fcb |
permissions | -rw-r--r-- |
61656 | 1 |
(*:maxLineLen=78:*) |
61575 | 2 |
|
48578 | 3 |
theory Sessions |
4 |
imports Base |
|
5 |
begin |
|
6 |
||
58618 | 7 |
chapter \<open>Isabelle sessions and build management \label{ch:session}\<close> |
48584 | 8 |
|
61575 | 9 |
text \<open> |
10 |
An Isabelle \<^emph>\<open>session\<close> consists of a collection of related theories that may |
|
11 |
be associated with formal documents (\chref{ch:present}). There is also a |
|
12 |
notion of \<^emph>\<open>persistent heap\<close> image to capture the state of a session, |
|
13 |
similar to object-code in compiled programming languages. Thus the concept |
|
14 |
of session resembles that of a ``project'' in common IDE environments, but |
|
15 |
the specific name emphasizes the connection to interactive theorem proving: |
|
16 |
the session wraps-up the results of user-interaction with the prover in a |
|
17 |
persistent form. |
|
48584 | 18 |
|
61575 | 19 |
Application sessions are built on a given parent session, which may be built |
20 |
recursively on other parents. Following this path in the hierarchy |
|
21 |
eventually leads to some major object-logic session like \<open>HOL\<close>, which itself |
|
22 |
is based on \<open>Pure\<close> as the common root of all sessions. |
|
48584 | 23 |
|
61575 | 24 |
Processing sessions may take considerable time. Isabelle build management |
25 |
helps to organize this efficiently. This includes support for parallel build |
|
26 |
jobs, in addition to the multithreaded theory and proof checking that is |
|
27 |
already provided by the prover process itself. |
|
28 |
\<close> |
|
48604 | 29 |
|
48578 | 30 |
|
58618 | 31 |
section \<open>Session ROOT specifications \label{sec:session-root}\<close> |
48578 | 32 |
|
61575 | 33 |
text \<open> |
34 |
Session specifications reside in files called \<^verbatim>\<open>ROOT\<close> within certain |
|
35 |
directories, such as the home locations of registered Isabelle components or |
|
36 |
additional project directories given by the user. |
|
48579 | 37 |
|
61575 | 38 |
The ROOT file format follows the lexical conventions of the \<^emph>\<open>outer syntax\<close> |
39 |
of Isabelle/Isar, see also @{cite "isabelle-isar-ref"}. This defines common |
|
40 |
forms like identifiers, names, quoted strings, verbatim text, nested |
|
41 |
comments etc. The grammar for @{syntax session_chapter} and @{syntax |
|
42 |
session_entry} is given as syntax diagram below; each ROOT file may contain |
|
43 |
multiple specifications like this. Chapters help to organize browser info |
|
44 |
(\secref{sec:info}), but have no formal meaning. The default chapter is |
|
45 |
``\<open>Unsorted\<close>''. |
|
48579 | 46 |
|
61575 | 47 |
Isabelle/jEdit @{cite "isabelle-jedit"} includes a simple editing mode |
48 |
\<^verbatim>\<open>isabelle-root\<close> for session ROOT files, which is enabled by default for any |
|
49 |
file of that name. |
|
48579 | 50 |
|
55112
b1a5d603fd12
prefer rail cartouche -- avoid back-slashed quotes;
wenzelm
parents:
54705
diff
changeset
|
51 |
@{rail \<open> |
51417 | 52 |
@{syntax_def session_chapter}: @'chapter' @{syntax name} |
53 |
; |
|
54 |
||
66971 | 55 |
@{syntax_def session_entry}: @'session' @{syntax system_name} groups? dir? '=' \<newline> |
56 |
(@{syntax system_name} '+')? description? options? \<newline> |
|
57 |
(sessions?) (theories*) (document_files*) |
|
48579 | 58 |
; |
59 |
groups: '(' (@{syntax name} +) ')' |
|
60 |
; |
|
61 |
dir: @'in' @{syntax name} |
|
62 |
; |
|
63 |
description: @'description' @{syntax text} |
|
64 |
; |
|
65 |
options: @'options' opts |
|
66 |
; |
|
48605
e777363440d6
allow negative int values as well, according to real = int | float;
wenzelm
parents:
48604
diff
changeset
|
67 |
opts: '[' ( (@{syntax name} '=' value | @{syntax name}) + ',' ) ']' |
e777363440d6
allow negative int values as well, according to real = int | float;
wenzelm
parents:
48604
diff
changeset
|
68 |
; |
e777363440d6
allow negative int values as well, according to real = int | float;
wenzelm
parents:
48604
diff
changeset
|
69 |
value: @{syntax name} | @{syntax real} |
48579 | 70 |
; |
66916 | 71 |
sessions: @'sessions' (@{syntax system_name}+) |
65374 | 72 |
; |
66970
13857f49d215
clarified ROOT syntax: 'sessions' and 'theories' are optional, but need to be non-empty;
wenzelm
parents:
66916
diff
changeset
|
73 |
theories: @'theories' opts? (theory_entry+) |
48579 | 74 |
; |
66916 | 75 |
theory_entry: @{syntax system_name} ('(' @'global' ')')? |
65504 | 76 |
; |
56533
cd8b6d849b6a
explicit 'document_files' in session ROOT specifications;
wenzelm
parents:
55112
diff
changeset
|
77 |
document_files: @'document_files' ('(' dir ')')? (@{syntax name}+) |
55112
b1a5d603fd12
prefer rail cartouche -- avoid back-slashed quotes;
wenzelm
parents:
54705
diff
changeset
|
78 |
\<close>} |
48579 | 79 |
|
61575 | 80 |
\<^descr> \isakeyword{session}~\<open>A = B + body\<close> defines a new session \<open>A\<close> based on |
66759 | 81 |
parent session \<open>B\<close>, with its content given in \<open>body\<close> (imported sessions and |
82 |
theories). Note that a parent (like \<open>HOL\<close>) is mandatory in practical |
|
83 |
applications: only Isabelle/Pure can bootstrap itself from nothing. |
|
48579 | 84 |
|
65504 | 85 |
All such session specifications together describe a hierarchy (graph) of |
61575 | 86 |
sessions, with globally unique names. The new session name \<open>A\<close> should be |
87 |
sufficiently long and descriptive to stand on its own in a potentially large |
|
88 |
library. |
|
48579 | 89 |
|
61575 | 90 |
\<^descr> \isakeyword{session}~\<open>A (groups)\<close> indicates a collection of groups where |
91 |
the new session is a member. Group names are uninterpreted and merely follow |
|
92 |
certain conventions. For example, the Isabelle distribution tags some |
|
93 |
important sessions by the group name called ``\<open>main\<close>''. Other projects may |
|
94 |
invent their own conventions, but this requires some care to avoid clashes |
|
48604 | 95 |
within this unchecked name space. |
48579 | 96 |
|
61575 | 97 |
\<^descr> \isakeyword{session}~\<open>A\<close>~\isakeyword{in}~\<open>dir\<close> specifies an explicit |
98 |
directory for this session; by default this is the current directory of the |
|
99 |
\<^verbatim>\<open>ROOT\<close> file. |
|
48579 | 100 |
|
66759 | 101 |
All theory files are located relatively to the session directory. The prover |
102 |
process is run within the same as its current working directory. |
|
48579 | 103 |
|
61575 | 104 |
\<^descr> \isakeyword{description}~\<open>text\<close> is a free-form annotation for this |
105 |
session. |
|
48579 | 106 |
|
61575 | 107 |
\<^descr> \isakeyword{options}~\<open>[x = a, y = b, z]\<close> defines separate options |
108 |
(\secref{sec:system-options}) that are used when processing this session, |
|
109 |
but \<^emph>\<open>without\<close> propagation to child sessions. Note that \<open>z\<close> abbreviates \<open>z = |
|
110 |
true\<close> for Boolean options. |
|
111 |
||
65504 | 112 |
\<^descr> \isakeyword{sessions}~\<open>names\<close> specifies sessions that are \<^emph>\<open>imported\<close> into |
113 |
the current name space of theories. This allows to refer to a theory \<open>A\<close> |
|
114 |
from session \<open>B\<close> by the qualified name \<open>B.A\<close> --- although it is loaded again |
|
115 |
into the current ML process, which is in contrast to a theory that is |
|
116 |
already present in the \<^emph>\<open>parent\<close> session. |
|
117 |
||
65505 | 118 |
Theories that are imported from other sessions are excluded from the current |
119 |
session document. |
|
120 |
||
61575 | 121 |
\<^descr> \isakeyword{theories}~\<open>options names\<close> specifies a block of theories that |
122 |
are processed within an environment that is augmented by the given options, |
|
123 |
in addition to the global session options given before. Any number of blocks |
|
124 |
of \isakeyword{theories} may be given. Options are only active for each |
|
48604 | 125 |
\isakeyword{theories} block separately. |
48579 | 126 |
|
65374 | 127 |
A theory name that is followed by \<open>(\<close>\isakeyword{global}\<open>)\<close> is treated |
66993 | 128 |
literally in other session specifications or theory imports --- the normal |
129 |
situation is to qualify theory names by the session name; this ensures |
|
130 |
globally unique names in big session graphs. Global theories are usually the |
|
131 |
entry points to major logic sessions: \<open>Pure\<close>, \<open>Main\<close>, \<open>Complex_Main\<close>, |
|
132 |
\<open>HOLCF\<close>, \<open>IFOL\<close>, \<open>FOL\<close>, \<open>ZF\<close>, \<open>ZFC\<close> etc. Regular Isabelle applications |
|
133 |
should not claim any global theory names. |
|
65374 | 134 |
|
61575 | 135 |
\<^descr> \isakeyword{document_files}~\<open>(\<close>\isakeyword{in}~\<open>base_dir) files\<close> lists |
136 |
source files for document preparation, typically \<^verbatim>\<open>.tex\<close> and \<^verbatim>\<open>.sty\<close> for |
|
137 |
{\LaTeX}. Only these explicitly given files are copied from the base |
|
138 |
directory to the document output directory, before formal document |
|
139 |
processing is started (see also \secref{sec:tool-document}). The local path |
|
140 |
structure of the \<open>files\<close> is preserved, which allows to reconstruct the |
|
141 |
original directory hierarchy of \<open>base_dir\<close>. |
|
56533
cd8b6d849b6a
explicit 'document_files' in session ROOT specifications;
wenzelm
parents:
55112
diff
changeset
|
142 |
|
61493 | 143 |
\<^descr> \isakeyword{document_files}~\<open>files\<close> abbreviates |
61575 | 144 |
\isakeyword{document_files}~\<open>(\<close>\isakeyword{in}~\<open>document) files\<close>, i.e.\ |
145 |
document sources are taken from the base directory \<^verbatim>\<open>document\<close> within the |
|
146 |
session root directory. |
|
58618 | 147 |
\<close> |
48579 | 148 |
|
51055 | 149 |
|
58618 | 150 |
subsubsection \<open>Examples\<close> |
48580 | 151 |
|
61575 | 152 |
text \<open> |
63680 | 153 |
See \<^file>\<open>~~/src/HOL/ROOT\<close> for a diversity of practically relevant situations, |
154 |
although it uses relatively complex quasi-hierarchic naming conventions like |
|
155 |
\<^verbatim>\<open>HOL-SPARK\<close>, \<^verbatim>\<open>HOL-SPARK-Examples\<close>. An alternative is to use unqualified |
|
156 |
names that are relatively long and descriptive, as in the Archive of Formal |
|
157 |
Proofs (\<^url>\<open>http://afp.sourceforge.net\<close>), for example. |
|
61575 | 158 |
\<close> |
48578 | 159 |
|
160 |
||
58618 | 161 |
section \<open>System build options \label{sec:system-options}\<close> |
48578 | 162 |
|
61575 | 163 |
text \<open> |
63680 | 164 |
See \<^file>\<open>~~/etc/options\<close> for the main defaults provided by the Isabelle |
61575 | 165 |
distribution. Isabelle/jEdit @{cite "isabelle-jedit"} includes a simple |
166 |
editing mode \<^verbatim>\<open>isabelle-options\<close> for this file-format. |
|
48693
ceeea46bdeba
"isabelle options" prints Isabelle system options;
wenzelm
parents:
48684
diff
changeset
|
167 |
|
61575 | 168 |
The following options are particularly relevant to build Isabelle sessions, |
169 |
in particular with document preparation (\chref{ch:present}). |
|
51055 | 170 |
|
61575 | 171 |
\<^item> @{system_option_def "browser_info"} controls output of HTML browser |
172 |
info, see also \secref{sec:info}. |
|
51055 | 173 |
|
61575 | 174 |
\<^item> @{system_option_def "document"} specifies the document output format, |
175 |
see @{tool document} option \<^verbatim>\<open>-o\<close> in \secref{sec:tool-document}. In |
|
176 |
practice, the most relevant values are \<^verbatim>\<open>document=false\<close> or |
|
177 |
\<^verbatim>\<open>document=pdf\<close>. |
|
51055 | 178 |
|
61575 | 179 |
\<^item> @{system_option_def "document_output"} specifies an alternative |
180 |
directory for generated output of the document preparation system; the |
|
181 |
default is within the @{setting "ISABELLE_BROWSER_INFO"} hierarchy as |
|
182 |
explained in \secref{sec:info}. See also @{tool mkroot}, which generates a |
|
183 |
default configuration with output readily available to the author of the |
|
184 |
document. |
|
51055 | 185 |
|
61575 | 186 |
\<^item> @{system_option_def "document_variants"} specifies document variants as |
187 |
a colon-separated list of \<open>name=tags\<close> entries, corresponding to @{tool |
|
188 |
document} options \<^verbatim>\<open>-n\<close> and \<^verbatim>\<open>-t\<close>. |
|
51055 | 189 |
|
61575 | 190 |
For example, \<^verbatim>\<open>document_variants=document:outline=/proof,/ML\<close> indicates |
191 |
two documents: the one called \<^verbatim>\<open>document\<close> with default tags, and the other |
|
192 |
called \<^verbatim>\<open>outline\<close> where proofs and ML sections are folded. |
|
51055 | 193 |
|
61575 | 194 |
Document variant names are just a matter of conventions. It is also |
195 |
possible to use different document variant names (without tags) for |
|
196 |
different document root entries, see also \secref{sec:tool-document}. |
|
51055 | 197 |
|
67140 | 198 |
\<^item> @{system_option_def "document_tags"} specifies a default for otherwise |
199 |
untagged commands. This is occasionally useful to control the global |
|
200 |
visibility of commands via session options (e.g. in \<^verbatim>\<open>ROOT\<close>). |
|
201 |
||
61575 | 202 |
\<^item> @{system_option_def "threads"} determines the number of worker threads |
203 |
for parallel checking of theories and proofs. The default \<open>0\<close> means that a |
|
204 |
sensible maximum value is determined by the underlying hardware. For |
|
205 |
machines with many cores or with hyperthreading, this is often requires |
|
206 |
manual adjustment (on the command-line or within personal settings or |
|
207 |
preferences, not within a session \<^verbatim>\<open>ROOT\<close>). |
|
51055 | 208 |
|
63827
b24d0e53dd03
option "checkpoint" helps to fine-tune global heap space management;
wenzelm
parents:
63680
diff
changeset
|
209 |
\<^item> @{system_option_def "checkpoint"} helps to fine-tune the global heap |
b24d0e53dd03
option "checkpoint" helps to fine-tune global heap space management;
wenzelm
parents:
63680
diff
changeset
|
210 |
space management. This is relevant for big sessions that may exhaust the |
b24d0e53dd03
option "checkpoint" helps to fine-tune global heap space management;
wenzelm
parents:
63680
diff
changeset
|
211 |
small 32-bit address space of the ML process (which is used by default). |
b24d0e53dd03
option "checkpoint" helps to fine-tune global heap space management;
wenzelm
parents:
63680
diff
changeset
|
212 |
When the option is enabled for some \isakeyword{theories} block, a full |
b24d0e53dd03
option "checkpoint" helps to fine-tune global heap space management;
wenzelm
parents:
63680
diff
changeset
|
213 |
sharing stage of immutable values in memory happens \<^emph>\<open>before\<close> loading the |
b24d0e53dd03
option "checkpoint" helps to fine-tune global heap space management;
wenzelm
parents:
63680
diff
changeset
|
214 |
specified theories. |
b24d0e53dd03
option "checkpoint" helps to fine-tune global heap space management;
wenzelm
parents:
63680
diff
changeset
|
215 |
|
61575 | 216 |
\<^item> @{system_option_def "condition"} specifies a comma-separated list of |
217 |
process environment variables (or Isabelle settings) that are required for |
|
218 |
the subsequent theories to be processed. Conditions are considered |
|
219 |
``true'' if the corresponding environment value is defined and non-empty. |
|
51055 | 220 |
|
61602 | 221 |
\<^item> @{system_option_def "timeout"} and @{system_option_def "timeout_scale"} |
222 |
specify a real wall-clock timeout for the session as a whole: the two |
|
223 |
values are multiplied and taken as the number of seconds. Typically, |
|
224 |
@{system_option "timeout"} is given for individual sessions, and |
|
225 |
@{system_option "timeout_scale"} as global adjustment to overall hardware |
|
226 |
performance. |
|
227 |
||
228 |
The timer is controlled outside the ML process by the JVM that runs |
|
229 |
Isabelle/Scala. Thus it is relatively reliable in canceling processes that |
|
230 |
get out of control, even if there is a deadlock without CPU time usage. |
|
51055 | 231 |
|
64308 | 232 |
\<^item> @{system_option_def "profiling"} specifies a mode for global ML |
233 |
profiling. Possible values are the empty string (disabled), \<^verbatim>\<open>time\<close> for |
|
234 |
@{ML profile_time} and \<^verbatim>\<open>allocations\<close> for @{ML profile_allocations}. |
|
235 |
Results appear near the bottom of the session log file. |
|
236 |
||
61575 | 237 |
The @{tool_def options} tool prints Isabelle system options. Its |
48693
ceeea46bdeba
"isabelle options" prints Isabelle system options;
wenzelm
parents:
48684
diff
changeset
|
238 |
command-line usage is: |
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
239 |
@{verbatim [display] |
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
240 |
\<open>Usage: isabelle options [OPTIONS] [MORE_OPTIONS ...] |
48693
ceeea46bdeba
"isabelle options" prints Isabelle system options;
wenzelm
parents:
48684
diff
changeset
|
241 |
|
ceeea46bdeba
"isabelle options" prints Isabelle system options;
wenzelm
parents:
48684
diff
changeset
|
242 |
Options are: |
ceeea46bdeba
"isabelle options" prints Isabelle system options;
wenzelm
parents:
48684
diff
changeset
|
243 |
-b include $ISABELLE_BUILD_OPTIONS |
52735 | 244 |
-g OPTION get value of OPTION |
50531
f841ac0cb757
clarified "isabelle options" command line, to make it more close to "isabelle components";
wenzelm
parents:
50406
diff
changeset
|
245 |
-l list options |
48693
ceeea46bdeba
"isabelle options" prints Isabelle system options;
wenzelm
parents:
48684
diff
changeset
|
246 |
-x FILE export to FILE in YXML format |
ceeea46bdeba
"isabelle options" prints Isabelle system options;
wenzelm
parents:
48684
diff
changeset
|
247 |
|
50531
f841ac0cb757
clarified "isabelle options" command line, to make it more close to "isabelle components";
wenzelm
parents:
50406
diff
changeset
|
248 |
Report Isabelle system options, augmented by MORE_OPTIONS given as |
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
249 |
arguments NAME=VAL or NAME.\<close>} |
48693
ceeea46bdeba
"isabelle options" prints Isabelle system options;
wenzelm
parents:
48684
diff
changeset
|
250 |
|
61575 | 251 |
The command line arguments provide additional system options of the form |
252 |
\<open>name\<close>\<^verbatim>\<open>=\<close>\<open>value\<close> or \<open>name\<close> for Boolean options. |
|
253 |
||
254 |
Option \<^verbatim>\<open>-b\<close> augments the implicit environment of system options by the ones |
|
255 |
of @{setting ISABELLE_BUILD_OPTIONS}, cf.\ \secref{sec:tool-build}. |
|
48693
ceeea46bdeba
"isabelle options" prints Isabelle system options;
wenzelm
parents:
48684
diff
changeset
|
256 |
|
61575 | 257 |
Option \<^verbatim>\<open>-g\<close> prints the value of the given option. Option \<^verbatim>\<open>-l\<close> lists all |
258 |
options with their declaration and current value. |
|
48693
ceeea46bdeba
"isabelle options" prints Isabelle system options;
wenzelm
parents:
48684
diff
changeset
|
259 |
|
61575 | 260 |
Option \<^verbatim>\<open>-x\<close> specifies a file to export the result in YXML format, instead |
261 |
of printing it in human-readable form. |
|
58618 | 262 |
\<close> |
48578 | 263 |
|
264 |
||
58618 | 265 |
section \<open>Invoking the build process \label{sec:tool-build}\<close> |
48578 | 266 |
|
61575 | 267 |
text \<open> |
268 |
The @{tool_def build} tool invokes the build process for Isabelle sessions. |
|
269 |
It manages dependencies between sessions, related sources of theories and |
|
270 |
auxiliary files, and target heap images. Accordingly, it runs instances of |
|
271 |
the prover process with optional document preparation. Its command-line |
|
272 |
usage is:\<^footnote>\<open>Isabelle/Scala provides the same functionality via |
|
61572 | 273 |
\<^verbatim>\<open>isabelle.Build.build\<close>.\<close> |
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
274 |
@{verbatim [display] |
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
275 |
\<open>Usage: isabelle build [OPTIONS] [SESSIONS ...] |
48578 | 276 |
|
277 |
Options are: |
|
66737
2edc0c42c883
option -B for "isabelle build" and "isabelle imports";
wenzelm
parents:
66671
diff
changeset
|
278 |
-B NAME include session NAME and all descendants |
48737
f3bbb9ca57d6
added build option -D: include session directory and select its sessions;
wenzelm
parents:
48693
diff
changeset
|
279 |
-D DIR include session directory and select its sessions |
64265 | 280 |
-N cyclic shuffling of NUMA CPU nodes (performance tuning) |
49131 | 281 |
-R operate on requirements of selected sessions |
66745 | 282 |
-S soft build: only observe changes of sources, not heap images |
60106 | 283 |
-X NAME exclude sessions from group NAME and all descendants |
48578 | 284 |
-a select all sessions |
285 |
-b build heap images |
|
48595 | 286 |
-c clean build |
48737
f3bbb9ca57d6
added build option -D: include session directory and select its sessions;
wenzelm
parents:
48693
diff
changeset
|
287 |
-d DIR include session directory |
66841 | 288 |
-f fresh build |
48578 | 289 |
-g NAME select session group NAME |
290 |
-j INT maximum number of parallel jobs (default 1) |
|
59891
9ce697050455
added isabelle build option -k, for fast off-line checking of theory sources;
wenzelm
parents:
59446
diff
changeset
|
291 |
-k KEYWORD check theory sources for conflicts with proposed keywords |
48903 | 292 |
-l list session source files |
48578 | 293 |
-n no build -- test dependencies only |
52056 | 294 |
-o OPTION override Isabelle system OPTION (via NAME=VAL or NAME) |
48578 | 295 |
-s system build mode: produce output in ISABELLE_HOME |
296 |
-v verbose |
|
60106 | 297 |
-x NAME exclude session NAME and all descendants |
48578 | 298 |
|
62596 | 299 |
Build and manage Isabelle sessions, depending on implicit settings: |
300 |
||
48578 | 301 |
ISABELLE_BUILD_OPTIONS="..." |
302 |
||
303 |
ML_PLATFORM="..." |
|
304 |
ML_HOME="..." |
|
305 |
ML_SYSTEM="..." |
|
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
306 |
ML_OPTIONS="..."\<close>} |
48578 | 307 |
|
61406 | 308 |
\<^medskip> |
61575 | 309 |
Isabelle sessions are defined via session ROOT files as described in |
310 |
(\secref{sec:session-root}). The totality of sessions is determined by |
|
311 |
collecting such specifications from all Isabelle component directories |
|
312 |
(\secref{sec:components}), augmented by more directories given via options |
|
313 |
\<^verbatim>\<open>-d\<close>~\<open>DIR\<close> on the command line. Each such directory may contain a session |
|
61503 | 314 |
\<^verbatim>\<open>ROOT\<close> file with several session specifications. |
48578 | 315 |
|
61575 | 316 |
Any session root directory may refer recursively to further directories of |
317 |
the same kind, by listing them in a catalog file \<^verbatim>\<open>ROOTS\<close> line-by-line. This |
|
318 |
helps to organize large collections of session specifications, or to make |
|
66576 | 319 |
\<^verbatim>\<open>-d\<close> command line options persistent (e.g.\ in |
61503 | 320 |
\<^verbatim>\<open>$ISABELLE_HOME_USER/ROOTS\<close>). |
48684
9170e10c651e
re-introduced ROOTS catalog files (cf. 47330b712f8f) which help to organize AFP or make -d options persistent;
wenzelm
parents:
48683
diff
changeset
|
321 |
|
61406 | 322 |
\<^medskip> |
61575 | 323 |
The subset of sessions to be managed is determined via individual \<open>SESSIONS\<close> |
324 |
given as command-line arguments, or session groups that are given via one or |
|
325 |
more options \<^verbatim>\<open>-g\<close>~\<open>NAME\<close>. Option \<^verbatim>\<open>-a\<close> selects all sessions. The build tool |
|
326 |
takes session dependencies into account: the set of selected sessions is |
|
327 |
completed by including all ancestors. |
|
48578 | 328 |
|
61406 | 329 |
\<^medskip> |
66737
2edc0c42c883
option -B for "isabelle build" and "isabelle imports";
wenzelm
parents:
66671
diff
changeset
|
330 |
One or more options \<^verbatim>\<open>-B\<close>~\<open>NAME\<close> specify base sessions. All descendants |
2edc0c42c883
option -B for "isabelle build" and "isabelle imports";
wenzelm
parents:
66671
diff
changeset
|
331 |
are included. |
2edc0c42c883
option -B for "isabelle build" and "isabelle imports";
wenzelm
parents:
66671
diff
changeset
|
332 |
|
2edc0c42c883
option -B for "isabelle build" and "isabelle imports";
wenzelm
parents:
66671
diff
changeset
|
333 |
\<^medskip> |
61575 | 334 |
One or more options \<^verbatim>\<open>-x\<close>~\<open>NAME\<close> specify sessions to be excluded. All |
335 |
descendents of excluded sessions are removed from the selection as specified |
|
336 |
above. Option \<^verbatim>\<open>-X\<close> is analogous to this, but excluded sessions are |
|
337 |
specified by session group membership. |
|
59892
2a616319c171
added isabelle build option -x, to exclude sessions;
wenzelm
parents:
59891
diff
changeset
|
338 |
|
61406 | 339 |
\<^medskip> |
61575 | 340 |
Option \<^verbatim>\<open>-R\<close> reverses the selection in the sense that it refers to its |
341 |
requirements: all ancestor sessions excluding the original selection. This |
|
342 |
allows to prepare the stage for some build process with different options, |
|
343 |
before running the main build itself (without option \<^verbatim>\<open>-R\<close>). |
|
49131 | 344 |
|
61406 | 345 |
\<^medskip> |
61575 | 346 |
Option \<^verbatim>\<open>-D\<close> is similar to \<^verbatim>\<open>-d\<close>, but selects all sessions that are defined |
347 |
in the given directories. |
|
48737
f3bbb9ca57d6
added build option -D: include session directory and select its sessions;
wenzelm
parents:
48693
diff
changeset
|
348 |
|
61406 | 349 |
\<^medskip> |
66745 | 350 |
Option \<^verbatim>\<open>-S\<close> indicates a ``soft build'': the selection is restricted to |
351 |
those sessions that have changed sources (according to actually imported |
|
352 |
theories). The status of heap images is ignored. |
|
353 |
||
354 |
\<^medskip> |
|
61406 | 355 |
The build process depends on additional options |
61575 | 356 |
(\secref{sec:system-options}) that are passed to the prover eventually. The |
357 |
settings variable @{setting_ref ISABELLE_BUILD_OPTIONS} allows to provide |
|
61602 | 358 |
additional defaults, e.g.\ \<^verbatim>\<open>ISABELLE_BUILD_OPTIONS="document=pdf threads=4"\<close>. |
359 |
Moreover, the environment of system build options may be augmented on the |
|
360 |
command line via \<^verbatim>\<open>-o\<close>~\<open>name\<close>\<^verbatim>\<open>=\<close>\<open>value\<close> or \<^verbatim>\<open>-o\<close>~\<open>name\<close>, which abbreviates |
|
361 |
\<^verbatim>\<open>-o\<close>~\<open>name\<close>\<^verbatim>\<open>=true\<close> for Boolean options. Multiple occurrences of \<^verbatim>\<open>-o\<close> on |
|
362 |
the command-line are applied in the given order. |
|
48578 | 363 |
|
61406 | 364 |
\<^medskip> |
61575 | 365 |
Option \<^verbatim>\<open>-b\<close> ensures that heap images are produced for all selected |
366 |
sessions. By default, images are only saved for inner nodes of the hierarchy |
|
367 |
of sessions, as required for other sessions to continue later on. |
|
48578 | 368 |
|
61406 | 369 |
\<^medskip> |
61575 | 370 |
Option \<^verbatim>\<open>-c\<close> cleans all descendants of the selected sessions before |
371 |
performing the specified build operation. |
|
48595 | 372 |
|
61406 | 373 |
\<^medskip> |
66841 | 374 |
Option \<^verbatim>\<open>-f\<close> forces a fresh build of all selected sessions and their |
375 |
requirements. |
|
376 |
||
377 |
\<^medskip> |
|
61575 | 378 |
Option \<^verbatim>\<open>-n\<close> omits the actual build process after the preparatory stage |
379 |
(including optional cleanup). Note that the return code always indicates the |
|
380 |
status of the set of selected sessions. |
|
48595 | 381 |
|
61406 | 382 |
\<^medskip> |
61575 | 383 |
Option \<^verbatim>\<open>-j\<close> specifies the maximum number of parallel build jobs (prover |
384 |
processes). Each prover process is subject to a separate limit of parallel |
|
385 |
worker threads, cf.\ system option @{system_option_ref threads}. |
|
48578 | 386 |
|
61406 | 387 |
\<^medskip> |
64265 | 388 |
Option \<^verbatim>\<open>-N\<close> enables cyclic shuffling of NUMA CPU nodes. This may help |
389 |
performance tuning on Linux servers with separate CPU/memory modules. |
|
390 |
||
391 |
\<^medskip> |
|
61575 | 392 |
Option \<^verbatim>\<open>-s\<close> enables \<^emph>\<open>system mode\<close>, which means that resulting heap images |
63669 | 393 |
and log files are stored in @{path "$ISABELLE_HOME/heaps"} instead of the |
394 |
default location @{setting ISABELLE_OUTPUT} (which is normally in @{setting |
|
395 |
ISABELLE_HOME_USER}, i.e.\ the user's home directory). |
|
48578 | 396 |
|
61406 | 397 |
\<^medskip> |
61575 | 398 |
Option \<^verbatim>\<open>-v\<close> increases the general level of verbosity. Option \<^verbatim>\<open>-l\<close> lists |
399 |
the source files that contribute to a session. |
|
59891
9ce697050455
added isabelle build option -k, for fast off-line checking of theory sources;
wenzelm
parents:
59446
diff
changeset
|
400 |
|
61406 | 401 |
\<^medskip> |
61575 | 402 |
Option \<^verbatim>\<open>-k\<close> specifies a newly proposed keyword for outer syntax (multiple |
403 |
uses allowed). The theory sources are checked for conflicts wrt.\ this |
|
404 |
hypothetical change of syntax, e.g.\ to reveal occurrences of identifiers |
|
405 |
that need to be quoted. |
|
406 |
\<close> |
|
59891
9ce697050455
added isabelle build option -k, for fast off-line checking of theory sources;
wenzelm
parents:
59446
diff
changeset
|
407 |
|
48578 | 408 |
|
58618 | 409 |
subsubsection \<open>Examples\<close> |
48578 | 410 |
|
58618 | 411 |
text \<open> |
48578 | 412 |
Build a specific logic image: |
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
413 |
@{verbatim [display] \<open>isabelle build -b HOLCF\<close>} |
48578 | 414 |
|
61406 | 415 |
\<^smallskip> |
416 |
Build the main group of logic images: |
|
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
417 |
@{verbatim [display] \<open>isabelle build -b -g main\<close>} |
48578 | 418 |
|
61406 | 419 |
\<^smallskip> |
66748 | 420 |
Build all descendants (and requirements) of \<^verbatim>\<open>FOL\<close> and \<^verbatim>\<open>ZF\<close>: |
421 |
@{verbatim [display] \<open>isabelle build -B FOL -B ZF\<close>} |
|
422 |
||
423 |
\<^smallskip> |
|
424 |
Build all sessions where sources have changed (ignoring heaps): |
|
425 |
@{verbatim [display] \<open>isabelle build -a -S\<close>} |
|
426 |
||
427 |
\<^smallskip> |
|
61575 | 428 |
Provide a general overview of the status of all Isabelle sessions, without |
429 |
building anything: |
|
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
430 |
@{verbatim [display] \<open>isabelle build -a -n -v\<close>} |
48578 | 431 |
|
61406 | 432 |
\<^smallskip> |
61575 | 433 |
Build all sessions with HTML browser info and PDF document preparation: |
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
434 |
@{verbatim [display] \<open>isabelle build -a -o browser_info -o document=pdf\<close>} |
48578 | 435 |
|
61406 | 436 |
\<^smallskip> |
61575 | 437 |
Build all sessions with a maximum of 8 parallel prover processes and 4 |
438 |
worker threads each (on a machine with many cores): |
|
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
439 |
@{verbatim [display] \<open>isabelle build -a -j8 -o threads=4\<close>} |
48595 | 440 |
|
61406 | 441 |
\<^smallskip> |
61575 | 442 |
Build some session images with cleanup of their descendants, while retaining |
443 |
their ancestry: |
|
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
444 |
@{verbatim [display] \<open>isabelle build -b -c HOL-Algebra HOL-Word\<close>} |
48595 | 445 |
|
61406 | 446 |
\<^smallskip> |
447 |
Clean all sessions without building anything: |
|
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
448 |
@{verbatim [display] \<open>isabelle build -a -n -c\<close>} |
48737
f3bbb9ca57d6
added build option -D: include session directory and select its sessions;
wenzelm
parents:
48693
diff
changeset
|
449 |
|
61406 | 450 |
\<^smallskip> |
61575 | 451 |
Build all sessions from some other directory hierarchy, according to the |
452 |
settings variable \<^verbatim>\<open>AFP\<close> that happens to be defined inside the Isabelle |
|
453 |
environment: |
|
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
454 |
@{verbatim [display] \<open>isabelle build -D '$AFP'\<close>} |
49131 | 455 |
|
61406 | 456 |
\<^smallskip> |
61575 | 457 |
Inform about the status of all sessions required for AFP, without building |
458 |
anything yet: |
|
61407
7ba7b8103565
@{verbatim [display]} supersedes old alltt/ttbox;
wenzelm
parents:
61406
diff
changeset
|
459 |
@{verbatim [display] \<open>isabelle build -D '$AFP' -R -v -n\<close>} |
58618 | 460 |
\<close> |
48578 | 461 |
|
66671 | 462 |
|
463 |
section \<open>Maintain theory imports wrt.\ session structure\<close> |
|
464 |
||
465 |
text \<open> |
|
466 |
The @{tool_def "imports"} tool helps to maintain theory imports wrt.\ |
|
467 |
session structure. It supports three main operations via options \<^verbatim>\<open>-I\<close>, |
|
468 |
\<^verbatim>\<open>-M\<close>, \<^verbatim>\<open>-U\<close>. Its command-line usage is: @{verbatim [display] |
|
469 |
\<open>Usage: isabelle imports [OPTIONS] [SESSIONS ...] |
|
470 |
||
471 |
Options are: |
|
66737
2edc0c42c883
option -B for "isabelle build" and "isabelle imports";
wenzelm
parents:
66671
diff
changeset
|
472 |
-B NAME include session NAME and all descendants |
66671 | 473 |
-D DIR include session directory and select its sessions |
66851
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
474 |
-I operation: report session imports |
66671 | 475 |
-M operation: Mercurial repository check for theory files |
476 |
-R operate on requirements of selected sessions |
|
477 |
-U operation: update theory imports to use session qualifiers |
|
478 |
-X NAME exclude sessions from group NAME and all descendants |
|
479 |
-a select all sessions |
|
480 |
-d DIR include session directory |
|
481 |
-g NAME select session group NAME |
|
482 |
-i incremental update according to session graph structure |
|
483 |
-o OPTION override Isabelle system OPTION (via NAME=VAL or NAME) |
|
484 |
-v verbose |
|
485 |
-x NAME exclude session NAME and all descendants |
|
486 |
||
487 |
Maintain theory imports wrt. session structure. At least one operation |
|
488 |
needs to be specified (see options -I -M -U).\<close>} |
|
489 |
||
490 |
\<^medskip> |
|
491 |
The selection of sessions and session directories works as for @{tool build} |
|
66737
2edc0c42c883
option -B for "isabelle build" and "isabelle imports";
wenzelm
parents:
66671
diff
changeset
|
492 |
via options \<^verbatim>\<open>-B\<close>, \<^verbatim>\<open>-D\<close>, \<^verbatim>\<open>-R\<close>, \<^verbatim>\<open>-X\<close>, \<^verbatim>\<open>-a\<close>, \<^verbatim>\<open>-d\<close>, \<^verbatim>\<open>-g\<close>, \<^verbatim>\<open>-x\<close> (see |
66671 | 493 |
\secref{sec:tool-build}). |
494 |
||
495 |
\<^medskip> |
|
496 |
Option \<^verbatim>\<open>-o\<close> overrides Isabelle system options as for @{tool build} |
|
497 |
(see \secref{sec:tool-build}). |
|
498 |
||
499 |
\<^medskip> |
|
500 |
Option \<^verbatim>\<open>-v\<close> increases the general level of verbosity. |
|
501 |
||
502 |
\<^medskip> |
|
66851
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
503 |
Option \<^verbatim>\<open>-I\<close> determines reports session imports: |
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
504 |
|
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
505 |
\<^descr>[Potential session imports] are derived from old-style use of theory |
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
506 |
files from other sessions via the directory structure. After declaring |
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
507 |
those as \isakeyword{sessions} in the corresponding \<^verbatim>\<open>ROOT\<close> file entry, a |
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
508 |
proper session-qualified theory name can be used (cf.\ option \<^verbatim>\<open>-U\<close>). For |
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
509 |
example, adhoc \<^theory_text>\<open>imports\<close> \<^verbatim>\<open>"~~/src/HOL/Library/Multiset"\<close> becomes formal |
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
510 |
\<^theory_text>\<open>imports\<close> \<^verbatim>\<open>"HOL-Library.Multiset"\<close> after adding \isakeyword{sessions} |
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
511 |
\<^verbatim>\<open>"HOL-Library"\<close> to the \<^verbatim>\<open>ROOT\<close> entry. |
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
512 |
|
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
513 |
\<^descr>[Actual session imports] are derived from the session qualifiers of all |
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
514 |
currently imported theories. This helps to minimize dependencies in the |
c75769065548
more informative Imports.Report with actual session imports (minimized);
wenzelm
parents:
66841
diff
changeset
|
515 |
session import structure to what is actually required. |
66671 | 516 |
|
517 |
\<^medskip> |
|
518 |
Option \<^verbatim>\<open>-M\<close> checks imported theories against the Mercurial repositories of |
|
519 |
the underlying session directories; non-repository directories are ignored. |
|
520 |
This helps to find files that are accidentally ignored, e.g.\ due to |
|
521 |
rearrangements of the session structure. |
|
522 |
||
523 |
\<^medskip> |
|
524 |
Option \<^verbatim>\<open>-U\<close> updates theory imports with old-style directory specifications |
|
525 |
to canonical session-qualified theory names, according to the theory name |
|
526 |
space imported via \isakeyword{sessions} within the \<^verbatim>\<open>ROOT\<close> specification. |
|
527 |
||
528 |
Option \<^verbatim>\<open>-i\<close> modifies the meaning of option \<^verbatim>\<open>-U\<close> to proceed incrementally, |
|
529 |
following to the session graph structure in bottom-up order. This may |
|
530 |
lead to more accurate results in complex session hierarchies. |
|
531 |
\<close> |
|
532 |
||
533 |
subsubsection \<open>Examples\<close> |
|
534 |
||
535 |
text \<open> |
|
536 |
Determine potential session imports for some project directory: |
|
537 |
@{verbatim [display] \<open>isabelle imports -I -D 'some/where/My_Project'\<close>} |
|
538 |
||
539 |
\<^smallskip> |
|
540 |
Mercurial repository check for some project directory: |
|
541 |
@{verbatim [display] \<open>isabelle imports -M -D 'some/where/My_Project'\<close>} |
|
542 |
||
543 |
\<^smallskip> |
|
544 |
Incremental update of theory imports for some project directory: |
|
545 |
@{verbatim [display] \<open>isabelle imports -U -i -D 'some/where/My_Project'\<close>} |
|
546 |
\<close> |
|
547 |
||
48578 | 548 |
end |