Top "Lexer" questions

A program converting a sequence of characters into a sequence of tokens

C++ parser generator

I'm writing my own scripting language and I need a software tool which generates C++ code for parsing my language. …

c++ parsing lexer lexical
Best way to tokenize and parse programming languages in my application

I'm working on a tool that will perform some simple transformations on programs (like extract method). To do this, I …

programming-languages parsing lexer
Lexer/parser tools

Which lexer/parser generator is the best (easiest to use, fastest) for C or C++? I'm using flex and bison …

parsing antlr bison lexer flex-lexer
How should I handle lexical errors in my Flex lexer?

I'm currently trying to write a small compiler using Flex+Bison but I'm kinda of lost in terms of what …

bison yacc lex flex-lexer lexer
Token recognition error: antlr

I have an ANTLR 4 grammar: grammar Test; start : NonZeroDigit '.' Digit Digit? EOF ; DOT : '.' ; PLUS : '+' ; …

antlr grammar antlr4 lexer antlrworks2
Generate AST of a PHP source file

I want to parse a PHP source file, into an AST (preferably as a nested array of instructions). I basically …

php parsing lexer
Lexical Analyser In Java

I have been trying to write a simple lexical analyzer in java . The File Token.java looks as follows : import …

java lexer
hand coding a parser

For all you compiler gurus, I wanna write a recursive descent parser and I wanna do it with just code. …

c# compiler-construction parsing lexer
ANTLR What is simpliest way to realize python like indent-depending grammar?

I am trying realize python like indent-depending grammar. Source example: ABC QWE CDE EFG EFG CDE ABC QWE ZXC As …

antlr lexer indentation
Using ANTLR Parser and Lexer Separatly

I used ANTLR version 4 for creating compiler.First Phase was the Lexer part. I created "CompilerLexer.g4" file and putted …

c# grammar antlr4 lexer