Jeandle: How Ant Group’s LLVM‑Based JVM JIT Aims to Supercharge Java Performance

Introduction

Jeandle is an open‑source Just‑In‑Time (JIT) compiler for the OpenJDK HotSpot JVM. It replaces the traditional HotSpot JIT backend with LLVM, leveraging LLVM’s optimization and code‑generation capabilities to improve Java application performance.

What is a JIT Compiler?

A JIT compiler monitors the execution of Java bytecode and, when a method becomes hot (frequently executed), compiles it into optimized native machine code. This reduces the overhead of interpretation and yields significant speedups.

What is LLVM?

LLVM is a modular compiler framework that provides:

Front‑ends that translate source code into LLVM IR (Intermediate Representation).

An optimizer that performs analysis and transformations on the IR.

Back‑ends that generate native CPU instructions from the optimized IR.

Its strengths include aggressive optimizations, a flexible architecture, and a large open‑source ecosystem.

Jeandle Architecture

Jeandle keeps the existing Java bytecode front‑end of HotSpot but delegates optimization and code generation to LLVM. The workflow is:

HotSpot’s interpreter identifies hot bytecode.

Jeandle forwards the bytecode to LLVM.

LLVM converts the code to IR, applies its optimizations, and emits native machine code.

The native code is linked back into the JVM for execution.

Technical Challenges

Integrating LLVM with the JVM requires solving several problems:

Full support for JVM garbage‑collection (GC) mechanisms.

Mapping Java dynamic features such as synchronized, exception handling, and class loading to LLVM constructs.

Designing Java‑specific optimizations (e.g., lock elision, escape analysis, aggressive inlining) within the LLVM pipeline.

Future Roadmap

End of 2025 : Complete bytecode coverage, including exception handling, GC, and synchronization.

2026 : Release a Java‑focused optimization suite, add Intrinsics for hand‑written assembly kernels, and implement On‑Stack Replacement (OSR) for dynamic hot‑swap.

2026+ : Support the modern G1 garbage collector and continue extending LLVM‑based optimizations.

Project Links

Source code and build instructions are available on GitHub:

https://github.com/jeandle/jeandle-jdk

https://github.com/jeandle/jeandle-l