Sat, 09 Aug 2008 12:28:09 +0200 added literal;
wenzelm [Sat, 09 Aug 2008 12:28:09 +0200] rev 27804
added literal;
Sat, 09 Aug 2008 00:09:39 +0200 read_token: more robust handling of empty text;
wenzelm [Sat, 09 Aug 2008 00:09:39 +0200] rev 27803
read_token: more robust handling of empty text;
Sat, 09 Aug 2008 00:09:38 +0200 datatype token: maintain range, tuned representation;
wenzelm [Sat, 09 Aug 2008 00:09:38 +0200] rev 27802
datatype token: maintain range, tuned representation; moved eof, stopper to lexicon.ML;
(0) -10000 -3000 -1000 -300 -100 -30 -10 -3 +3 +10 +30 +100 +300 +1000 +3000 +10000 +30000 tip