Top "Lexer" questions

A program converting a sequence of characters into a sequence of tokens

lexers vs parsers

Are lexers and parsers really that different in theory? It seems fashionable to hate regular expressions: coding horror, another blog …

parsing antlr lexer pygments
Where can I learn the basics of writing a lexer?

I want to learn how to write a lexer. My university course had an assignment where we had to write …

language-agnostic lexer compiler-construction
Looking for a clear definition of what a "tokenizer", "parser" and "lexers" are and how they are related to each other and used?

I am looking for a clear definition of what a "tokenizer", "parser" and "lexer" are and how they are related …

parsing lexer tokenize
ANTLR4 visitor pattern on simple arithmetic example

I am a complete ANTLR4 newbie, so please forgive my ignorance. I ran into this presentation where a very simple …

java antlr antlr4 lexer
Poor man's "lexer" for C#

I'm trying to write a very simple parser in C#. I need a lexer -- something that lets me associate …

c# regex lexer
Lexer written in Javascript?

I have a project where a user needs to define a set of instructions for a ui that is completely …

javascript parsing generator lexer
What does \v and \r mean? Are they white spaces?

I'm taking a course on lexical analysis, and \t\v\r is used in the lexer token definitions to represent …

whitespace lexer
Does C# have (direct) flex/yacc port? Or what lexer/parser people use for C#?

I might be wrong, but it looks like that there's no direct flex/bison (lex/yacc) port for C#/.NET …

c# .net parsing lexer
Good parser generator (think lex/yacc or antlr) for .NET? Build time only?

Is there a good parser generator (think lex/yacc or antlr) for .NET? Any that have a license that would …

.net parsing antlr yacc lexer
Parse tree generation with Java CUP

I am using CUP with JFlex to validate expression syntax. I have the basic functionality working: I can tell if …

parsing grammar lexer jflex cup