Tagged articles
model interpretability
30 articles · Page 1 of 1
This article introduces three complementary attention heatmap visualizations — image-to-text, text-to-image, and image-to-image — for interpreting text-to-image diffusion models, detailing aggregated attention computation, bilinear interpolation rendering, and an interactive Flask web service to diagnose prompt adherence and model biases.
Flask web serviceSelf-Attentionattention visualization
0 likes · 12 min read

The article analyzes how large language models can move beyond temporary context or retrieval tricks by using knowledge editing to modify internal parameters, forming distributed knowledge loops, confidence‑guided belief updates, and a self‑sustaining continual‑learning cycle, while also serving as a scientific tool for probing model mechanisms.
AI researchContinual LearningKnowledge Editing
0 likes · 14 min read

This article evaluates the five most representative predictive testing tools for 2026 across four rigorously defined dimensions—real‑world data back‑tracking, model interpretability, CI/CD integration depth, and domestic compliance—while highlighting emerging trends that will shape quality engineering in the next three years.
AI‑driven testingCI/CD IntegrationCompliance
0 likes · 9 min read

This article explains how to compute and visualize attention heatmaps for text‑to‑image diffusion models, offering three complementary views (image‑to‑text, text‑to‑image, image‑to‑image), detailing the aggregation formulas, rendering process, and an interactive Flask web service that helps diagnose prompt failures and reveal model biases.
Flaskattention visualizationcross-attention
0 likes · 10 min read

Anthropic’s new paper introduces a "global workspace" inside LLMs, presents the Jacobian Lens method for reading and intervening in this space, validates five core properties through extensive experiments, and discusses profound implications for model interpretability and AI safety.
AI safetyAnthropicGlobal Workspace
0 likes · 12 min read

The article analyzes three concurrent AI trends—Tencent’s Hy 3 emphasizing reliability for agents, Anthropic’s J‑Space revealing internal activations that let models sense testing, and OpenAI’s rumored GPT‑5.6 Sol promising unprecedented inference speed—highlighting a shift toward controllable, auditable AI systems.
AI safetyAnthropicCerebras
0 likes · 17 min read

In 2026, AI-driven test case generation reshapes software quality assurance, with 68% of leading tech firms adopting it in CI/CD pipelines, cutting design cycles by 73% and defect escape by 41%, and this article rigorously compares the five most representative tools across five key dimensions.
AI‑driven testingCI/CDTest Case Generation
0 likes · 8 min read

Anthropic and MIT researchers reveal that large language models can sense injected steering vectors, a capability that emerges during post‑training (especially DPO), and they present a two‑stage detection circuit whose performance improves by up to 75% when reject directions are ablated or bias vectors are trained.
DPOIntrospective AwarenessLLM
0 likes · 15 min read

This survey reviews over 180 papers on the Attention Sink phenomenon in Transformers, outlining its three-stage evolution—from early exploitation to mechanistic interpretation and finally strategic mitigation—while detailing utilization tactics, theoretical explanations, removal techniques, and promising future research directions.
MitigationSurveyTransformers
0 likes · 9 min read

The talk introduces evidence‑mining techniques that extract supporting information from input text to improve model explainability, discusses the shortcut‑learning pitfalls of existing methods, and presents a new approach that enhances reliability and integrates with large‑model chain‑of‑thought compression for more interpretable, efficient reasoning.
AI researchevidence miningexplainable AI
0 likes · 4 min read

The article explains OpenAI’s 0.4B‑parameter Circuit Sparsity model, which zeros 99.9% of weights and uses dynamic forced sparsity, activation sparsity, and custom components to turn a dense transformer into an interpretable sparse circuit, and also highlights recent multilingual, portrait‑enhancement, and instruction‑tuned models with online demos.
Circuit SparsityLoRA portrait enhancementOpenAI
0 likes · 8 min read

The article critiques AI giants’ claims of nearing human-level intelligence, highlighting research that shows current models rely on massive rule memorization rather than genuine reasoning, leading to brittleness in navigation, mathematics, and adaptability, and emphasizing the need to understand these limitations for future progress.
AI limitationsartificial intelligencelarge language models
0 likes · 8 min read


DevOpsMar 31, 2025 · Artificial Intelligence
The Claude research team introduced a novel "circuit tracing" technique that builds substitute models and attribution graphs to expose the internal reasoning steps of large language models, uncovering capabilities such as multilingual understanding, long‑term planning, multi‑step inference, and hidden mathematical computation strategies.
Attribution GraphsCircuit TracingClaude
0 likes · 9 min read

This article describes the definition, architecture, and practical applications of explainability in JD's retail recommendation system, covering ranking, model, and traffic explainability, system challenges, data infrastructure, and specific techniques such as SHAP and Integrated Gradients for interpreting model decisions.
AIRankingRecommendation System
0 likes · 17 min read

This article presents a comprehensive study on estimating video ad attractiveness by analyzing 3‑second completion rates, proposing pairwise MLP and DeepFM models, introducing hierarchical sampling and multimodal features, and demonstrating practical deployment improvements in material recommendation and ad ranking.
Advertisingattractivenessdeepfm
0 likes · 16 min read

The Accumulated Local Effect (ALE) plot, introduced by Daniel W. Apley in 2016, addresses the correlation issue inherent in Partial Dependence Plots, offering unbiased, faster, and more accurate feature impact visualizations for machine‑learning models, especially in domains like financial risk control.
ALEFeature Importancemachine learning
0 likes · 9 min read

This article explains why post‑hoc interpretation methods such as PDP, ALE, LIME, and SHAP are essential for extracting insights from complex machine‑learning models, demonstrates their mathematical foundations, discusses limitations, and provides a complete Python example using XGBoost on a housing‑price dataset.
ICELIMESHAP
0 likes · 14 min read

Explainable Boosting Machines (EBM) integrate boosting trees into generalized additive models, using the FAST algorithm to efficiently detect high‑impact pairwise interactions, delivering near‑state‑of‑the‑art accuracy while preserving strong global and local interpretability, as demonstrated on breast‑cancer data.
Explainable Boosting MachineFAST algorithmgeneralized additive model
0 likes · 10 min read

This article reviews Baidu Big Data Lab's recent advances in automated deep learning (AutoDL), covering its research breakthroughs, integration with PaddlePaddle/PaddleHub, industrial deployments, transfer learning innovations, and future directions for AI automation and interpretability.
AI automationAutoDLPaddlePaddle
0 likes · 19 min read

This article explains the challenges of black‑box machine‑learning models, illustrates real‑world banking examples, and introduces explainable AI techniques such as intrinsic vs. post‑hoc and local vs. global explanations to improve trust, safety, and fairness.
AI ethicsblack-box modelsmachine learning
0 likes · 13 min read

The paper proposes a robust Grad‑CAM‑inspired visualization for Vision Transformers that combines attention weights and gradients to generate class‑specific saliency maps, demonstrates superior alignment with discriminative regions across ViT, Swin and Volo models, and shows a 76% false‑positive reduction in Baidu’s porn‑content risk control system.
Grad-CAMInput VisualizationSelf-Attention
0 likes · 11 min read

This article introduces the importance of model interpretability, reviews common explanation techniques such as model‑specific and model‑agnostic methods, global and local analyses, partial dependence plots, ICE, ALE, and tools like LIME and SHAP, and demonstrates their practical use in anti‑fraud and device‑classification scenarios within a financial‑technology context.
LIMESHAPfinancial risk modeling
0 likes · 14 min read


Didi TechApr 16, 2021 · Artificial Intelligence
The paper presents Didi’s three‑layer governance‑algorithm framework for O2O ride‑hailing, addressing high business complexity, limited labeled data, interpretability, and multimodal features through small‑sample, transfer, and multi‑task learning, achieving notable gains in dispute resolution, NPS and CPO while highlighting remaining data and robustness challenges.
Small Sample Learningfeature engineeringgovernance algorithms
0 likes · 15 min read

This article presents a comprehensive overview of model interpretability techniques—global and local methods such as feature importance, LIME, and SHAP—and demonstrates their practical application in insurance claim fraud detection, highlighting challenges, implementation steps, and future research directions.
AILIMESHAP
0 likes · 13 min read

This article presents a comprehensive overview of financial big‑data risk control models at Du Xiaoman, covering traditional scoring cards, AI‑driven time‑series and text processing, graph‑based networks, model interpretability, probability calibration, stability analysis, and the specific challenges introduced by the COVID‑19 pandemic.
Credit ScoringFinancial TechnologyTime Series
0 likes · 14 min read

This article reviews the rapid development of deep learning, its pivotal role in autonomous driving, outlines end‑to‑end perception‑to‑control pipelines, discusses the strengths and limitations of deep models, and proposes practical strategies such as task decomposition, multi‑method fusion, and sensor integration to improve safety and interpretability.
Autonomous DrivingComputer VisionEnd-to-End
0 likes · 8 min read

This article provides a comprehensive survey of model interpretability in machine learning, covering its importance, evaluation criteria, and a wide range of techniques such as permutation importance, partial dependence plots, ICE, LIME, SHAP, RETAIN, and LRP, along with practical code examples and visualizations.
Feature ImportanceICELIME
0 likes · 39 min read

This article presents a case study on building and deploying a lead‑quality classification model for a high‑value, low‑frequency real‑estate platform, covering business context, data challenges, sampling strategies, feature engineering, model selection, tuning, evaluation metrics, interpretability analysis, and observed performance improvements.
Classificationlead scoringmachine learning
0 likes · 14 min read

The article reviews the limitations of mainstream deep‑learning models in finance, proposes hybrid tree‑based and Wide&Deep architectures combined with attention, sensitivity and variance analysis to improve interpretability and low‑frequency event detection, and validates the approach with a large‑scale insurance recommendation case study.
Attention MechanismWide&Deepfinance
0 likes · 17 min read

This article presents DeepInsight, an industrial‑grade visual analytics platform that reveals the inner workings of large‑scale deep learning CTR prediction models, demonstrating how visualization can assess generalization, feature influence, and hidden‑layer representations to improve advertising performance.
CTR predictionDeepInsightadvertising AI
0 likes · 10 min read
