wenzelm [Sat, 09 Aug 2008 00:09:39 +0200] rev 27803
read_token: more robust handling of empty text;
wenzelm [Sat, 09 Aug 2008 00:09:38 +0200] rev 27802
datatype token: maintain range, tuned representation;
moved eof, stopper to lexicon.ML;
wenzelm [Sat, 09 Aug 2008 00:09:36 +0200] rev 27801
datatype token: maintain range, tuned representation;
tuned messages;
wenzelm [Sat, 09 Aug 2008 00:09:35 +0200] rev 27800
datatype token: maintain range, tuned representation;
added eof, stopper (from simple_parse.ML);
str_of_token: no special case for EOF;
misc tuning;
wenzelm [Sat, 09 Aug 2008 00:09:34 +0200] rev 27799
tuned SymbolPos interface;
wenzelm [Sat, 09 Aug 2008 00:09:31 +0200] rev 27798
YXML.parse: allow text without markup, potentially empty;
wenzelm [Sat, 09 Aug 2008 00:09:29 +0200] rev 27797
added content;
simplified implode: interface and permissive padding via Position.distance_of;
added range;
renamed implode_delim to implode_range;
wenzelm [Sat, 09 Aug 2008 00:09:26 +0200] rev 27796
added distance_of (permissive version);
added no_range;
tuned;
wenzelm [Fri, 08 Aug 2008 19:29:01 +0200] rev 27795
count offset as well;
more uniform treatment of invalid fields;
tuned;
wenzelm [Fri, 08 Aug 2008 19:28:59 +0200] rev 27794
added offset/end_offset;