How HW‑RTOS Eliminates OS Overhead for Hard Real‑Time Performance

1. Background and Real‑Time Challenges

In industrial control, real‑time means that a computation must not only be logically correct but also finish within a strict deadline; missing the deadline can cause catastrophic failures. Traditional OS kernels provide multitasking, interrupt management, inter‑task communication, resource management, and time management, but they introduce overhead that slows down low‑frequency MCUs.

CPU scheduling in a multitasking OS works by dynamically selecting the next task based on its state and priority, which adds context‑switch latency and unpredictable interrupt‑disable periods.

2. Linux Real‑Time Patch (RT‑Preempt)

The Linux RT‑Preempt patch improves real‑time performance by:

Threading interrupts to reduce ISR latency.

Providing a high‑precision timer that can enter a no‑tick (NoHZ) state.

Replacing O(1) scheduler with the CFS O(log n) algorithm and adding the SCHED_FIFO real‑time policy.

Making critical sections preemptible and adding priority inheritance.

Although the patch reduces latency, Linux remains a soft‑real‑time system.

3. Xenomai + Linux Dual‑Kernel

By running a real‑time kernel (Xenomai) alongside Linux, real‑time tasks are scheduled on the Xenomai side while Linux handles non‑real‑time work. This approach can achieve hard‑real‑time performance but still suffers from OS‑API overhead in critical sections.

4. HW‑RTOS Concept

HW‑RTOS (hardware real‑time operating system) is a proprietary solution from Renesas that implements about 30 RTOS APIs directly in hardware, similar to a floating‑point unit. It offloads scheduling, API execution, and interrupt handling to dedicated hardware, providing deterministic execution times independent of software state.

Key benefits include:

Fast API execution with little jitter.

Low interrupt latency and very short interrupt‑disable periods.

Predictable worst‑case execution time (WCET) for each API.

HW‑RTOS uses three registers (API, argument, result) to communicate with the CPU via a thin OS library.

5. Optimization Point 1 – API Overhead

Software RTOS APIs often have O(n) complexity and execute with interrupts disabled, causing variable worst‑case latency. Measurements on ITRON show that API time depends on the number of waiting tasks and queue depth.

HW‑RTOS implements APIs in hardware, achieving constant execution times (typically <10 cycles) and eliminating state‑dependent jitter.

6. Optimization Point 2 – Tick Offloading

Traditional OS tick processing consumes CPU cycles, disables interrupts, and limits timer precision. HW‑RTOS implements the tick entirely in hardware (tick offloading), removing the periodic interrupt, improving CPU efficiency, and allowing much finer tick granularity.

7. Optimization Point 3 – Hardware ISR (HW ISR)

In software, ISR execution disables other interrupts and may require a context switch, adding latency. HW‑RTOS provides a hardware ISR that directly invokes the corresponding API, drastically reducing ISR execution time, interrupt‑disable periods, and the number of context switches.

8. Optimization Point 4 – Task Management

HW‑RTOS supports up to 64 tasks across 16 priority levels, with a fully hardware‑implemented preemptive scheduler and context‑switch logic (vector #76 and PendSV). Tasks are created by writing special values into task‑control blocks.

9. Typical Case – Network Stack Acceleration

Embedding HW‑RTOS in Renesas R‑IN32M3 devices offloads TCP/IP checksum calculation, packet re‑ordering, and memory copies to dedicated hardware, reducing CPU load and enabling high‑throughput UDP/IP at 100 MHz with minimal jitter.

10. Next‑Generation HW‑RTOS

Future HW‑RTOS designs will add tightly‑coupled interfaces, hardware‑implemented cyclic handlers with microsecond‑level intervals, and multi‑core support, further improving deterministic performance and lowering power consumption.

Code Example

void MyTask(void) {
    while (1) {
        // Wait for an event to occur
        // Perform task operation
    }
}

Representative HW‑RTOS APIs

Semaphore</code><code>Event flag</code><code>Mail box</code><code>Lock CPU and disable dispatch</code><code>Sleep / wakeup</code><code>Release waiting</code><code>Rotate ready queue</code><code>Change priority