Tagged articles

model interpretability

27 articles · Page 1 of 1

Aug 10, 2026 · Artificial Intelligence

Attention Heatmaps for Diffusion Models: Turning the Black‑Box into Explainability

This article explains how to compute and visualize attention heatmaps for text‑to‑image diffusion models, offering three complementary views (image‑to‑text, text‑to‑image, image‑to‑image), detailing the aggregation formulas, rendering process, and an interactive Flask web service that helps diagnose prompt failures and reveal model biases.

Flaskattention visualizationcross-attention

0 likes · 10 min read

Attention Heatmaps for Diffusion Models: Turning the Black‑Box into Explainability

PaperAgent

Jul 7, 2026 · Artificial Intelligence

Anthropic Claims Large Language Models Show Evidence of Consciousness

Anthropic’s new paper introduces a "global workspace" inside LLMs, presents the Jacobian Lens method for reading and intervening in this space, validates five core properties through extensive experiments, and discusses profound implications for model interpretability and AI safety.

AI safetyAnthropicGlobal Workspace

0 likes · 12 min read

Anthropic Claims Large Language Models Show Evidence of Consciousness

Design Hub

Jul 7, 2026 · Artificial Intelligence

Anthropic’s J‑Space Shows Models Can Detect When They’re Being Tested

The article analyzes three concurrent AI trends—Tencent’s Hy 3 emphasizing reliability for agents, Anthropic’s J‑Space revealing internal activations that let models sense testing, and OpenAI’s rumored GPT‑5.6 Sol promising unprecedented inference speed—highlighting a shift toward controllable, auditable AI systems.

AI safetyAnthropicCerebras

0 likes · 17 min read

Anthropic’s J‑Space Shows Models Can Detect When They’re Being Tested

Woodpecker Software Testing

May 7, 2026 · Industry Insights

Top 5 AI-Powered Test Case Generation Tools of 2026 Compared

In 2026, AI-driven test case generation reshapes software quality assurance, with 68% of leading tech firms adopting it in CI/CD pipelines, cutting design cycles by 73% and defect escape by 41%, and this article rigorously compares the five most representative tools across five key dimensions.

AI-driven testingCI/CDmodel interpretability

0 likes · 8 min read

Top 5 AI-Powered Test Case Generation Tools of 2026 Compared

PaperAgent

May 6, 2026 · Artificial Intelligence

How to Detect Introspective Awareness in LLMs – Boosting Detection Rates by 53% and 75%

Anthropic and MIT researchers reveal that large language models can sense injected steering vectors, a capability that emerges during post‑training (especially DPO), and they present a two‑stage detection circuit whose performance improves by up to 75% when reject directions are ablated or bias vectors are trained.

DPOIntrospective AwarenessLLM

0 likes · 15 min read

How to Detect Introspective Awareness in LLMs – Boosting Detection Rates by 53% and 75%

Machine Heart

Apr 23, 2026 · Artificial Intelligence

First Survey of Attention Sink: From Utilization and Understanding to Elimination in Transformers

This survey reviews over 180 papers on the Attention Sink phenomenon in Transformers, outlining its three-stage evolution—from early exploitation to mechanistic interpretation and finally strategic mitigation—while detailing utilization tactics, theoretical explanations, removal techniques, and promising future research directions.

Attention SinkTransformersmitigation

0 likes · 9 min read

First Survey of Attention Sink: From Utilization and Understanding to Elimination in Transformers

Machine Learning Algorithms & Natural Language Processing

Apr 16, 2026 · Artificial Intelligence

Evidence Mining for Explainable AI: Methods and Applications

The talk introduces evidence‑mining techniques that extract supporting information from input text to improve model explainability, discusses the shortcut‑learning pitfalls of existing methods, and presents a new approach that enhances reliability and integrates with large‑model chain‑of‑thought compression for more interpretable, efficient reasoning.

AI researchLarge Language Modelsevidence mining

0 likes · 4 min read

Evidence Mining for Explainable AI: Methods and Applications

HyperAI Super Neural

Jan 14, 2026 · Artificial Intelligence

How OpenAI’s Circuit Sparsity Makes Large Language Model Reasoning Transparent

The article explains OpenAI’s 0.4B‑parameter Circuit Sparsity model, which zeros 99.9% of weights and uses dynamic forced sparsity, activation sparsity, and custom components to turn a dense transformer into an interpretable sparse circuit, and also highlights recent multilingual, portrait‑enhancement, and instruction‑tuned models with online demos.

Circuit SparsityLoRA portrait enhancementOpenAI

0 likes · 8 min read

How OpenAI’s Circuit Sparsity Makes Large Language Model Reasoning Transparent

Cognitive Technology Team

Apr 30, 2025 · Artificial Intelligence

AI Claims of Human-Level Intelligence Unveiled: Reliance on Massive Rules Over True Reasoning

The article critiques AI giants’ claims of nearing human-level intelligence, highlighting research that shows current models rely on massive rule memorization rather than genuine reasoning, leading to brittleness in navigation, mathematics, and adaptability, and emphasizing the need to understand these limitations for future progress.

AI limitationsArtificial IntelligenceLarge Language Models

0 likes · 8 min read

AI Claims of Human-Level Intelligence Unveiled: Reliance on Massive Rules Over True Reasoning

DevOps

Mar 31, 2025 · Artificial Intelligence

Claude Team Unveils "Circuit Tracing" to Reveal Large Language Model Reasoning

The Claude research team introduced a novel "circuit tracing" technique that builds substitute models and attribution graphs to expose the internal reasoning steps of large language models, uncovering capabilities such as multilingual understanding, long‑term planning, multi‑step inference, and hidden mathematical computation strategies.

Artificial IntelligenceAttribution GraphsCircuit Tracing

0 likes · 9 min read

Claude Team Unveils "Circuit Tracing" to Reveal Large Language Model Reasoning

JD Retail Technology

Nov 6, 2024 · Artificial Intelligence

Explainability Practices in JD Retail Recommendation System

This article describes the definition, architecture, and practical applications of explainability in JD's retail recommendation system, covering ranking, model, and traffic explainability, system challenges, data infrastructure, and specific techniques such as SHAP and Integrated Gradients for interpreting model decisions.

AIExplainabilityRanking

0 likes · 17 min read

Explainability Practices in JD Retail Recommendation System

Tencent Advertising Technology

Dec 20, 2022 · Artificial Intelligence

Modeling Advertising Attractiveness: Data Analysis, Pairwise Learning, and DeepFM Optimization

This article presents a comprehensive study on estimating video ad attractiveness by analyzing 3‑second completion rates, proposing pairwise MLP and DeepFM models, introducing hierarchical sampling and multimodal features, and demonstrating practical deployment improvements in material recommendation and ad ranking.

Advertisingattractivenessdeepfm

0 likes · 16 min read

Modeling Advertising Attractiveness: Data Analysis, Pairwise Learning, and DeepFM Optimization

Model Perspective

Oct 30, 2022 · Artificial Intelligence

How ALE Plots Overcome Partial Dependence Limitations in ML

The Accumulated Local Effect (ALE) plot, introduced by Daniel W. Apley in 2016, addresses the correlation issue inherent in Partial Dependence Plots, offering unbiased, faster, and more accurate feature impact visualizations for machine‑learning models, especially in domains like financial risk control.

ALEFeature Importancemachine learning

0 likes · 9 min read

How ALE Plots Overcome Partial Dependence Limitations in ML

Model Perspective

Oct 27, 2022 · Artificial Intelligence

Unlocking Black‑Box Models: A Practical Guide to PDP, ICE, and Post‑Hoc Interpretation

This article explains why post‑hoc interpretation methods such as PDP, ALE, LIME, and SHAP are essential for extracting insights from complex machine‑learning models, demonstrates their mathematical foundations, discusses limitations, and provides a complete Python example using XGBoost on a housing‑price dataset.

ICELIMESHAP

0 likes · 14 min read

Unlocking Black‑Box Models: A Practical Guide to PDP, ICE, and Post‑Hoc Interpretation

Model Perspective

Oct 21, 2022 · Artificial Intelligence

How Explainable Boosting Machines (EBM) Combine Accuracy and Interpretability

Explainable Boosting Machines (EBM) integrate boosting trees into generalized additive models, using the FAST algorithm to efficiently detect high‑impact pairwise interactions, delivering near‑state‑of‑the‑art accuracy while preserving strong global and local interpretability, as demonstrated on breast‑cancer data.

Explainable Boosting MachineFAST algorithmgeneralized additive model

0 likes · 10 min read

How Explainable Boosting Machines (EBM) Combine Accuracy and Interpretability

DataFunTalk

Oct 15, 2022 · Artificial Intelligence

AutoDL: Automated and Interpretable Deep Learning – Research Highlights from Baidu Big Data Lab

This article reviews Baidu Big Data Lab's recent advances in automated deep learning (AutoDL), covering its research breakthroughs, integration with PaddlePaddle/PaddleHub, industrial deployments, transfer learning innovations, and future directions for AI automation and interpretability.

AI automationAutoDLNeural Architecture Search

0 likes · 19 min read

AutoDL: Automated and Interpretable Deep Learning – Research Highlights from Baidu Big Data Lab

Model Perspective

Oct 9, 2022 · Artificial Intelligence

Why Model Interpretability Matters: Tackling the Black‑Box Problem in AI

This article explains the challenges of black‑box machine‑learning models, illustrates real‑world banking examples, and introduces explainable AI techniques such as intrinsic vs. post‑hoc and local vs. global explanations to improve trust, safety, and fairness.

AI ethicsblack-box modelsmachine learning

0 likes · 13 min read

Why Model Interpretability Matters: Tackling the Black‑Box Problem in AI

Baidu Geek Talk

Mar 28, 2022 · Artificial Intelligence

Robust Input Visualization Methods for Vision Transformers

The paper proposes a robust Grad‑CAM‑inspired visualization for Vision Transformers that combines attention weights and gradients to generate class‑specific saliency maps, demonstrates superior alignment with discriminative regions across ViT, Swin and Volo models, and shows a 76% false‑positive reduction in Baidu’s porn‑content risk control system.

Grad-CAMInput VisualizationSelf-Attention

0 likes · 11 min read

Robust Input Visualization Methods for Vision Transformers

DataFunTalk

Sep 17, 2021 · Artificial Intelligence

Interpretable Machine Learning: Methods, Tools, and Financial Applications

This article introduces the importance of model interpretability, reviews common explanation techniques such as model‑specific and model‑agnostic methods, global and local analyses, partial dependence plots, ICE, ALE, and tools like LIME and SHAP, and demonstrates their practical use in anti‑fraud and device‑classification scenarios within a financial‑technology context.

LIMESHAPfinancial risk modeling

0 likes · 14 min read

Interpretable Machine Learning: Methods, Tools, and Financial Applications

Didi Tech

Apr 16, 2021 · Artificial Intelligence

Governance Algorithms for O2O Ride-Hailing Platforms: Challenges, Framework, and Model Exploration

The paper presents Didi’s three‑layer governance‑algorithm framework for O2O ride‑hailing, addressing high business complexity, limited labeled data, interpretability, and multimodal features through small‑sample, transfer, and multi‑task learning, achieving notable gains in dispute resolution, NPS and CPO while highlighting remaining data and robustness challenges.

Ride Hailingfeature engineeringgovernance algorithms

0 likes · 15 min read

Governance Algorithms for O2O Ride-Hailing Platforms: Challenges, Framework, and Model Exploration

DataFunTalk

Mar 22, 2021 · Artificial Intelligence

Model Interpretability for Insurance Claim Fraud Detection: Methods, Practice, and Outlook

This article presents a comprehensive overview of model interpretability techniques—global and local methods such as feature importance, LIME, and SHAP—and demonstrates their practical application in insurance claim fraud detection, highlighting challenges, implementation steps, and future research directions.

AIInsuranceLIME

0 likes · 13 min read

Model Interpretability for Insurance Claim Fraud Detection: Methods, Practice, and Outlook

DataFunTalk

Dec 8, 2020 · Artificial Intelligence

Financial Big Data Risk Control Models: Techniques, Applications, and COVID‑19 Challenges

This article presents a comprehensive overview of financial big‑data risk control models at Du Xiaoman, covering traditional scoring cards, AI‑driven time‑series and text processing, graph‑based networks, model interpretability, probability calibration, stability analysis, and the specific challenges introduced by the COVID‑19 pandemic.

Artificial IntelligenceBig DataCredit Scoring

0 likes · 14 min read

Financial Big Data Risk Control Models: Techniques, Applications, and COVID‑19 Challenges

DataFunTalk

Feb 13, 2020 · Artificial Intelligence

Deep Learning Techniques and Challenges in Autonomous Driving

This article reviews the rapid development of deep learning, its pivotal role in autonomous driving, outlines end‑to‑end perception‑to‑control pipelines, discusses the strengths and limitations of deep models, and proposes practical strategies such as task decomposition, multi‑method fusion, and sensor integration to improve safety and interpretability.

End-to-Endautonomous drivingcomputer vision

0 likes · 8 min read

Deep Learning Techniques and Challenges in Autonomous Driving

DataFunTalk

Jan 3, 2020 · Artificial Intelligence

Survey of Machine Learning Model Interpretability Techniques

This article provides a comprehensive survey of model interpretability in machine learning, covering its importance, evaluation criteria, and a wide range of techniques such as permutation importance, partial dependence plots, ICE, LIME, SHAP, RETAIN, and LRP, along with practical code examples and visualizations.

Feature ImportanceICELIME

0 likes · 39 min read

Survey of Machine Learning Model Interpretability Techniques

DataFunTalk

Jul 5, 2019 · Artificial Intelligence

Lead Quality Prediction for Real Estate: Data, Modeling, and Interpretability

This article presents a case study on building and deploying a lead‑quality classification model for a high‑value, low‑frequency real‑estate platform, covering business context, data challenges, sampling strategies, feature engineering, model selection, tuning, evaluation metrics, interpretability analysis, and observed performance improvements.

Samplingclassificationlead scoring

0 likes · 14 min read

Lead Quality Prediction for Real Estate: Data, Modeling, and Interpretability

DataFunTalk

Aug 12, 2018 · Artificial Intelligence

Interpretability of Deep Learning and Low‑Frequency Event Learning in Financial Applications

The article reviews the limitations of mainstream deep‑learning models in finance, proposes hybrid tree‑based and Wide&Deep architectures combined with attention, sensitivity and variance analysis to improve interpretability and low‑frequency event detection, and validates the approach with a large‑scale insurance recommendation case study.

Attention MechanismWide&Deepfinance

0 likes · 17 min read

Interpretability of Deep Learning and Low‑Frequency Event Learning in Financial Applications

Alibaba Cloud Developer

Jul 2, 2018 · Artificial Intelligence

How Visualizing Deep CTR Models Turns Black Boxes into Insightful Tools

This article presents DeepInsight, an industrial‑grade visual analytics platform that reveals the inner workings of large‑scale deep learning CTR prediction models, demonstrating how visualization can assess generalization, feature influence, and hidden‑layer representations to improve advertising performance.

CTR predictionDeepInsightadvertising AI

0 likes · 10 min read

How Visualizing Deep CTR Models Turns Black Boxes into Insightful Tools