Tag

lexical analysis

0 views collected around this technical thread.

JD Tech Talk
JD Tech Talk
Jan 3, 2025 · Fundamentals

Understanding Compiler Front‑End: Lexical, Syntax, and Semantic Analysis with Antlr

This article introduces the fundamentals of compiler front‑end development, covering lexical analysis with finite automata, syntax analysis using context‑free grammars and parsing strategies, and semantic analysis concepts, while providing practical Antlr examples for Java code tokenization, parsing, and semantic checks.

ANTLRCompilerlexical analysis
0 likes · 11 min read
Understanding Compiler Front‑End: Lexical, Syntax, and Semantic Analysis with Antlr
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Jun 2, 2022 · Fundamentals

Design and Implementation of TinyLanguage Using Flex and Bison

The article walks readers through designing and implementing TinyLanguage—a minimal interpreted language with 4‑byte integers, constants, if/else, for loops, and print—by using Flex for lexical analysis, Bison for parsing into an AST, and an execution engine, even showing a Fibonacci example and future LLVM compilation possibilities.

ASTCompilerFlex
0 likes · 30 min read
Design and Implementation of TinyLanguage Using Flex and Bison
Xueersi Online School Tech Team
Xueersi Online School Tech Team
Sep 4, 2020 · Databases

Understanding MySQL 8.0.20 Lexical Analysis: State Machine, Debugging Process, and Optimizations

This article explains MySQL 8.0.20's lexical analysis, describing the lexer’s role, the state‑machine implementation, step‑by‑step debugging with LLDB on macOS, the init_state_maps function, key source code snippets, and the optimizations introduced in this version.

Database InternalsMySQLSource Code
0 likes · 12 min read
Understanding MySQL 8.0.20 Lexical Analysis: State Machine, Debugging Process, and Optimizations
360 Quality & Efficiency
360 Quality & Efficiency
Jul 3, 2020 · Backend Development

Understanding PHP_CodeSniffer: Tokenization, Lexical Analysis, and Custom Rule Creation

This article explains how PHP_CodeSniffer parses PHP source code into tokens using lexical analysis, demonstrates token extraction with token_get_all, and guides readers through creating a custom rule to prohibit hash‑style comments, covering rule library setup, Sniff implementation, and execution.

Custom RulesPHPPHP_CodeSniffer
0 likes · 12 min read
Understanding PHP_CodeSniffer: Tokenization, Lexical Analysis, and Custom Rule Creation
Sohu Tech Products
Sohu Tech Products
Apr 8, 2020 · Fundamentals

Building an IntelliJ Plugin to Convert MySQL DDL into Python ORM Models Using Lexical Analysis

This article explains how to create a JetBrains IntelliJ plugin that parses MySQL DDL statements, performs lexical analysis to extract table and column information, and automatically generates corresponding Python ORM model classes, illustrating the underlying state‑machine lexer, recursive parsing logic, and sample code.

DDLIntelliJ PluginORM
0 likes · 9 min read
Building an IntelliJ Plugin to Convert MySQL DDL into Python ORM Models Using Lexical Analysis
360 Tech Engineering
360 Tech Engineering
Jun 25, 2019 · Fundamentals

Building an LL(1) SQL Parser in Go

This tutorial explains how to implement a simple LL(1) parser in Go for SQL queries, covering lexical analysis, syntax analysis, finite‑state‑machine strategy, and testing, providing complete code snippets and practical guidance for developers interested in parser construction.

CompilerGoLL(1) parser
0 likes · 9 min read
Building an LL(1) SQL Parser in Go
360 Quality & Efficiency
360 Quality & Efficiency
Nov 13, 2018 · Backend Development

Understanding PHP_CodeSniffer: Tokenization and Lexical Analysis in PHP

This article explains how PHP_CodeSniffer performs static analysis by tokenizing PHP source code, describes PHP’s execution process, clarifies the concept of tokens and how to retrieve them with token_get_all and token_name, and shows how this knowledge enables custom rule creation.

PHPStatic Analysisbackend
0 likes · 5 min read
Understanding PHP_CodeSniffer: Tokenization and Lexical Analysis in PHP