src/Pure/ML/ml_lex.ML
2009-06-01 wenzelm 2009-06-01 added flatten;
2009-03-24 wenzelm 2009-03-24 datatype antiquote: maintain original Position.range, which is eventually attached to the resulting ML tokens;
2009-03-22 wenzelm 2009-03-22 added read_antiq, with improved error reporting; tuned signature; tuned;
2009-03-22 wenzelm 2009-03-22 ML_Lex.pos_of: regular position; added ML_Lex.text_of;
2009-03-20 wenzelm 2009-03-20 report markup for ML tokens;
2009-03-20 wenzelm 2009-03-20 allow non-printable symbols within string tokens;
2009-03-19 wenzelm 2009-03-19 added scan_antiq; more robust scan_ml: plain scanning without cut, regular Symbol_Pos.content instead of Symbol_Pos.implode (which contains spurious Symbol.DEL is used with proper positions);
2009-03-19 wenzelm 2009-03-19 added tokenize; internal scan_str: ensure Symbol.is_regular, otherwise it might swallow the stopper and crash!
2009-03-18 wenzelm 2009-03-18 de-camelized Symbol_Pos;
2009-01-21 wenzelm 2009-01-21 removed Ids;
2008-08-09 wenzelm 2008-08-09 renamed ML_Lex.val_of to content_of;
2008-08-09 wenzelm 2008-08-09 tuned SymbolPos interface;
2008-08-07 wenzelm 2008-08-07 improved position handling due to SymbolPos.T; SymbolPos.scan_comment; tuned;
2008-08-04 wenzelm 2008-08-04 abstract type Scan.stopper;
2007-09-16 wenzelm 2007-09-16 removed obsolete Selector token; tuned signature; string syntax: proper escape format;
2007-09-15 wenzelm 2007-09-15 Lexical syntax for SML.