User:OrenBochman/ParserNG/Transliterator Antlr

Tranlitatrator Filter Antlr
"To make ANTLR generate lexers that behave like the UNIX utility sed (copy standard in to standard out except as specified by the replace patterns), use a filter rule that does the input to output copying:" - antlr docs

based on

the idea is to use a dictionary (map) or a conversion function to replace the detected char set.

Usage
this filter can be:
 * Integrated into the lexer (one scan would be fastest).
 * Run as a seperate step (modular, slow, easily configurable).

Issues

 * Best if translitration is an offset or a call to an outside module.
 * Dictionry and look ahead provide maximum tanliteration power.