Tagged articles

RAGAS

9 articles · Page 1 of 1
Tech Freedom Circle
Tech Freedom Circle
Jul 14, 2026 · Artificial Intelligence

Designing Production‑Grade Observability and Evaluation with Langfuse + RAGAS for LLM Applications

This article presents a comprehensive, production‑ready guide for building end‑to‑end observability and quantitative evaluation of LLM‑powered RAG/Agent systems using the open‑source Langfuse platform together with the RAGAS benchmark, covering architecture, installation, code instrumentation, dataset management, metric collection, and best‑practice recommendations.

LLM observabilityLangChainLangGraph
0 likes · 46 min read
Designing Production‑Grade Observability and Evaluation with Langfuse + RAGAS for LLM Applications
Woodpecker Software Testing
Woodpecker Software Testing
May 14, 2026 · Artificial Intelligence

AI Testing in Practice: 3 Real-World Case Studies

The article examines how AI testing has shifted from simple functional checks to evaluating model reliability, fairness, robustness, and explainability, illustrating the shift with three detailed client cases—financial bias audit, automotive voice‑assistant stress testing, and medical‑imaging consistency verification.

AI testingAequitasRAGAS
0 likes · 8 min read
AI Testing in Practice: 3 Real-World Case Studies
James' Growth Diary
James' Growth Diary
May 11, 2026 · Artificial Intelligence

Mastering RAG Evaluation: Recall@K, MRR, NDCG, and RAGAS Explained

This article breaks down RAG evaluation into a two‑layer framework, explains the four core metrics—Recall@K, MRR, NDCG, and the four RAGAS scores—shows how to implement them with LangChain.js, highlights common pitfalls, and offers scenario‑specific metric combinations for reliable performance monitoring.

EvaluationLangChainMRR
0 likes · 20 min read
Mastering RAG Evaluation: Recall@K, MRR, NDCG, and RAGAS Explained
Linyb Geek Road
Linyb Geek Road
May 5, 2026 · Artificial Intelligence

How to Fully Evaluate a RAG System – Metrics for Retrieval and Generation Stages

The article explains why RAG systems require stage‑wise evaluation, detailing retrieval metrics such as Precision, Recall, F1, MRR, NDCG and Context Relevance, and generation metrics like Faithfulness, Answer Relevance and Completeness, while discussing LLM‑as‑Judge automation and a three‑layer assessment framework.

EvaluationLLM-as-judgeRAG
0 likes · 14 min read
How to Fully Evaluate a RAG System – Metrics for Retrieval and Generation Stages
Woodpecker Software Testing
Woodpecker Software Testing
Apr 24, 2026 · Artificial Intelligence

5 Open‑Source Tools for Practical LLM Testing

As large language models move from labs to production, this article evaluates five high‑activity open‑source solutions—RAGAS, LLM‑eval, Promptfoo, Guardrails, and DeepEval—showing how they enable systematic, reproducible, and auditable testing across the entire CI/CD pipeline.

DeepEvalGuardrailsOpen-source tools
0 likes · 9 min read
5 Open‑Source Tools for Practical LLM Testing
AgentGuide
AgentGuide
Apr 3, 2026 · Artificial Intelligence

How to Evaluate RAG Systems: Key Metrics and the Ragas Framework

The article explains how to assess Retrieval-Augmented Generation (RAG) projects using the Ragas automated evaluation framework, detailing four key dimensions—recall quality, answer faithfulness, answer relevance, and context utilization—and describes the underlying metrics for both retrieval and generation stages.

EvaluationLLMRAG
0 likes · 5 min read
How to Evaluate RAG Systems: Key Metrics and the Ragas Framework
SuanNi
SuanNi
Mar 25, 2026 · Artificial Intelligence

How to Evaluate, Optimize, and Secure Retrieval‑Augmented Generation (RAG) Pipelines

This article explains the evaluation pillar of context engineering, introduces the three core RAG metrics (context relevance, faithfulness, answer relevance), details the RAGAS automated assessment framework, shows how to build evaluation datasets, adopt evaluation‑driven development, and protect RAG systems from prompt injection and data leakage.

LLMRAGRAGAS
0 likes · 13 min read
How to Evaluate, Optimize, and Secure Retrieval‑Augmented Generation (RAG) Pipelines
dbaplus Community
dbaplus Community
Jun 18, 2024 · Artificial Intelligence

How to Effectively Evaluate RAG Systems: Metrics, Tools, and Best Practices

Evaluating Retrieval‑Augmented Generation (RAG) systems requires both component‑level and end‑to‑end metrics—such as context relevance, recall, answer relevance, and groundedness—and can be automated with tools like TruLens, RAGAS, LangSmith, and Langfuse, enabling systematic selection and optimization of LLM applications.

AI metricsLLMLangSmith
0 likes · 8 min read
How to Effectively Evaluate RAG Systems: Metrics, Tools, and Best Practices