ULS

ULS or Unified Lexical Scheme is a class library that acts like a lexical analyzer for various programming languages. The idea behind this project is to provide compiler creators with a simplified language design that enables you to work with C, C++. C# and Java libraries without too much hassle. Consequentially, thanks to this tool, you can instantiate several class objects for one or more languages.

The idea behind the lexical analysis is to provide an accurate pre-processing for the stream of input characters and separate them into strings that are called tokens, which are generally separated via a whitespace. While most analyzers can do this task, you will be happy to learn that this tool is capable of much more.

Among the notable features of this class library, you can count mapping the tokens that you define to any 32-integer range of number and it can tokenize the input file that is encoded by ASCII, UTF-32, UTF-16 and UTF-8. It can be employed as a replacement for 'lex/flex' for the token provider to the yacc/bison parser and can store the tokens from many input files to a USL file that can be replayed. Speaking of USL, the tool enables you to manipulate both real and integer numbers that have an arbitrary number of digits.