Tagged articles
lexical analysis
15 articles · Page 1 of 1
This article walks through the fundamentals of compiler front‑end development, covering lexical analysis, parsing, and semantic analysis, and provides hands‑on Antlr examples for Java code to illustrate each stage.
ANTLRCompilerlexical analysis
0 likes · 11 min read

This article introduces the fundamentals of compiler front‑end development, covering lexical analysis with finite automata, syntax analysis using context‑free grammars and parsing strategies, and semantic analysis concepts, while providing practical Antlr examples for Java code tokenization, parsing, and semantic checks.
ANTLRCompilerSyntax Analysis
0 likes · 11 min read

This article explains how JavaScript parsers transform source code strings into abstract syntax trees through lexical analysis and syntax parsing, covering language types, V8’s execution flow, token generation, AST construction, and practical examples, while also linking to tools like AST Explorer for further exploration.
ASTParserSyntax Parsing
0 likes · 10 min read

The article explains why most programming languages forbid variable names that begin with digits, covering the definition of variables, Python's naming rules, human and computer confusion caused by such names, and the impact on code readability and maintainability.
Best PracticesCode Readabilitylexical analysis
0 likes · 4 min read

The article walks readers through designing and implementing TinyLanguage—a minimal interpreted language with 4‑byte integers, constants, if/else, for loops, and print—by using Flex for lexical analysis, Bison for parsing into an AST, and an execution engine, even showing a Fibonacci example and future LLVM compilation possibilities.
ASTBisonCompiler
0 likes · 30 min read

This article walks through creating a Python arithmetic interpreter with the PLY library, covering token definitions, lexer rules, BNF grammar, parser implementation, operator precedence, and a runnable REPL, providing complete code and explanations for each step.
BNFPLYPython
0 likes · 9 min read

This article walks through the design and implementation of a lightweight JSON parser in Java, covering the underlying lexical and syntax analysis, token definitions, core parsing algorithms, testing strategies, and a brief demonstration of JSON beautification, providing developers with a clear understanding of JSON processing fundamentals.
JSONJavaParser
0 likes · 18 min read

This article examines the trade‑offs between automatically generated and manually crafted SQL parsers, detailing lexical‑syntax analysis techniques, performance challenges in OLAP workloads, and the authors’ custom parser design that achieves up to 30‑50× speed gains in complex queries and bulk inserts.
ParserSQLdatabase
0 likes · 17 min read

This article explains MySQL 8.0.20's lexical analysis, describing the lexer’s role, the state‑machine implementation, step‑by‑step debugging with LLDB on macOS, the init_state_maps function, key source code snippets, and the optimizations introduced in this version.
Database InternalsDebuggingMySQL
0 likes · 12 min read

This article explains how PHP_CodeSniffer parses PHP source code into tokens using lexical analysis, demonstrates token extraction with token_get_all, and guides readers through creating a custom rule to prohibit hash‑style comments, covering rule library setup, Sniff implementation, and execution.
PHPPHP_CodeSniffercustom rules
0 likes · 12 min read

This article explains how to create a JetBrains IntelliJ plugin that parses MySQL DDL statements, performs lexical analysis to extract table and column information, and automatically generates corresponding Python ORM model classes, illustrating the underlying state‑machine lexer, recursive parsing logic, and sample code.
DDLIntelliJ PluginORM
0 likes · 9 min read

This tutorial explains how to implement a simple LL(1) parser in Go for SQL queries, covering lexical analysis, syntax analysis, finite‑state‑machine strategy, and testing, providing complete code snippets and practical guidance for developers interested in parser construction.
CompilerGoLL(1) parser
0 likes · 9 min read

This article demystifies how programming languages are transformed by compilers, covering the roles of lexical analysis, parsing, abstract syntax trees, code generation, and linking, with practical Rust examples, diagrams, and references to deepen your understanding of language implementation.
CompilerProgramming LanguageRust
0 likes · 14 min read


ITPUBJul 7, 2018 · Databases
This article explains why protecting database systems is critical, reviews existing SQL‑analysis tools, and dives deep into MySQL's lexical and syntax parsing techniques—including Bison‑generated parsers, core data structures, and practical applications such as useless‑condition removal and SQL feature generation—to help DBAs automate and optimize their workflows.
BisonDBA toolsMySQL
0 likes · 15 min read

This article explains Facebook's Hiphop tool, its evolution from static PHP-to-C++ compilation to HHVM with JIT, and provides a detailed walkthrough of compiler fundamentals including lexical, syntax, and semantic analysis, intermediate code generation, optimization, and code generation.
Compilercode-generationhhvm
0 likes · 13 min read
