BestHub
Sign in
Tagged articles

AI architecture

143 articles · Page 2 of 2
Instant Consumer Technology Team
Instant Consumer Technology Team
Sep 3, 2025 · Artificial Intelligence

Why Context Modeling Could Replace RAG – Insights from DeepVista CEO Jing Conan Wang

In a two‑hour interview, DeepVista CEO Jing Conan Wang explains how his new "context modeling" paradigm addresses the rigidity, lack of personalization, and performance limits of current RAG‑based AI agents, proposing a dual‑model architecture that learns and adapts context dynamically for faster, more accurate results.

AI architectureLLM OptimizationPersonalized AI
0 likes · 15 min read
Why Context Modeling Could Replace RAG – Insights from DeepVista CEO Jing Conan Wang
AI Algorithm Path
AI Algorithm Path
Aug 8, 2025 · Artificial Intelligence

GPT‑5 Is Here: In‑Depth Technical Walkthrough of Architecture, Features, and Benchmarks

OpenAI’s GPT‑5, released on August 7 2025, introduces a unified system with real‑time routing, up to 400 k token context windows, multiple model families, refined safety mechanisms, new API controls, and benchmark results that show it surpasses GPT‑4 across intelligence, coding, instruction following, function calling and multimodal tasks.

AI architectureAPIGPT-5
0 likes · 9 min read
GPT‑5 Is Here: In‑Depth Technical Walkthrough of Architecture, Features, and Benchmarks
Alibaba Cloud Developer
Alibaba Cloud Developer
Jul 29, 2025 · Artificial Intelligence

How to Transform Chaotic AI Prompts into Robust System Designs

This article examines the pitfalls of rule‑heavy prompt engineering, introduces a systematic four‑layer architecture for AI prompts, outlines six practical compilation principles, and demonstrates how to rewrite a tangled prompt into a clear, maintainable, and scalable system blueprint.

AI architectureLLMPrompt Engineering
0 likes · 84 min read
How to Transform Chaotic AI Prompts into Robust System Designs
AI Frontier Lectures
AI Frontier Lectures
Jul 24, 2025 · Artificial Intelligence

State Space Models vs Transformers: Uncovering the Real Trade‑offs in Sequence Modeling

This article analyzes the fundamental differences between state space models (SSM) and Transformer architectures, highlighting their three core components, training efficiency, memory handling, tokenization impact, and empirical performance trade‑offs, and argues why SSMs can outperform Transformers on many sequence tasks.

AI architectureSequence ModelingTransformers
0 likes · 19 min read
State Space Models vs Transformers: Uncovering the Real Trade‑offs in Sequence Modeling
Architect
Architect
Jul 11, 2025 · Artificial Intelligence

How OpenAI’s Zero‑Vector Agentic RAG Redefines AI Knowledge Retrieval

OpenAI’s new non‑vectorized Agentic RAG approach replaces traditional vector search with a hierarchical, multi‑round content selection process, leveraging large‑context models like GPT‑4.1‑mini for efficient document loading, dynamic navigation, and accurate answer generation, while outlining model selection strategies, cost trade‑offs, and production considerations.

AI architectureAgentic RetrievalModel Selection
0 likes · 15 min read
How OpenAI’s Zero‑Vector Agentic RAG Redefines AI Knowledge Retrieval
Data Thinking Notes
Data Thinking Notes
Jun 24, 2025 · Artificial Intelligence

Anthropic’s Multi‑Agent Research System: Architecture, Lessons & 90% Performance Boost

Anthropic’s detailed post explains how its new Research feature uses a multi‑agent architecture with a lead coordinator and parallel sub‑agents, covering design principles, prompt engineering tricks, evaluation methods, production reliability challenges, and the substantial performance gains achieved over single‑agent baselines.

AI architectureLLM researchPrompt Engineering
0 likes · 21 min read
Anthropic’s Multi‑Agent Research System: Architecture, Lessons & 90% Performance Boost
Alibaba Cloud Developer
Alibaba Cloud Developer
Jun 10, 2025 · Artificial Intelligence

How AI Application Architectures Evolve: From Simple LLM Calls to Guardrails, Routing, and Agents

This article traces the evolution of AI application architectures—from the earliest minimal user‑LLM interaction to advanced designs featuring context enhancement, input/output guardrails, intent routing, model gateways, caching strategies, agent capabilities, monitoring, and inference performance optimizations—providing practical insights and references for developers.

AI architectureAgentLLM
0 likes · 21 min read
How AI Application Architectures Evolve: From Simple LLM Calls to Guardrails, Routing, and Agents
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 9, 2025 · Artificial Intelligence

What Are Foundation Agents? A Deep Dive into Next‑Gen AI Architectures

This article reviews the 2025 "Advances and Challenges in Foundation Agents" paper, defining the Foundation Agent concept, detailing its seven core components, exploring self‑evolution, multi‑agent collaboration, and the safety and alignment challenges required to build trustworthy, autonomous AI systems.

AI architectureAlignmentFoundation Agents
0 likes · 16 min read
What Are Foundation Agents? A Deep Dive into Next‑Gen AI Architectures
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 5, 2025 · Artificial Intelligence

Why Large Models Are Redefining Software: The Four AI Tech Drivers

The article explains how rapid AI advances and the AIAgent architecture are reshaping software development, outlines four key technical drivers—embedding, Transformer scaling laws, scenario Moore's law, and LLM OS—and discusses the security, professionalism, and responsibility challenges enterprises face when deploying AI‑native applications.

AI architectureArtificial IntelligenceEmbedding
0 likes · 6 min read
Why Large Models Are Redefining Software: The Four AI Tech Drivers
Java Web Project
Java Web Project
Jun 4, 2025 · Artificial Intelligence

Why DeepSeek V3 Stands Out: Architecture, Performance, and Open‑Source Edge

The article analyzes DeepSeek's rapid adoption, detailing its seven core models, the third‑generation MoE architecture, FP8 mixed‑precision training, 128K context window, benchmark superiority on MMLU/HumanEval/CMMLU, low training cost, and fully open‑source release, while also introducing a companion guide for developers.

AI architectureDeepSeekFP8 training
0 likes · 9 min read
Why DeepSeek V3 Stands Out: Architecture, Performance, and Open‑Source Edge
DataFunSummit
DataFunSummit
Jun 2, 2025 · Artificial Intelligence

Enterprise Knowledge Brain Powered by Large Models and Knowledge Graphs

This article explains how the rapid development of large language models and knowledge graph technologies creates new opportunities for enterprise knowledge management, outlines the challenges of massive unstructured data, describes the architecture and core data flow of a corporate knowledge brain, and showcases key technologies and real‑world applications.

AI architectureData IntegrationEnterprise AI
0 likes · 13 min read
Enterprise Knowledge Brain Powered by Large Models and Knowledge Graphs
Tencent Technical Engineering
Tencent Technical Engineering
Apr 14, 2025 · Artificial Intelligence

MCP Protocol: Technical Principles and Business Applications

The article examines the Model Context Protocol (MCP), detailing its microkernel‑based technical architecture, development timeline from Anthropic’s 2024 release to industry adoption, hands‑on implementation examples, and business use cases such as multi‑agent QQ robots, highlighting MCP’s potential to standardize AI tool integration across industries.

AI ApplicationsAI architectureBusiness Implementation
0 likes · 14 min read
MCP Protocol: Technical Principles and Business Applications
Ma Wei Says
Ma Wei Says
Mar 15, 2025 · Artificial Intelligence

Understanding Model Context Protocol (MCP) vs. Function Calling

The Model Context Protocol (MCP), announced by Anthropic, standardizes how AI applications provide context to LLMs, offering a client‑server architecture that simplifies data and tool integration, and is compared with function calling, highlighting its benefits, workflow, controversies, and future prospects.

AI architectureAnthropicFunction Calling
0 likes · 9 min read
Understanding Model Context Protocol (MCP) vs. Function Calling
AI Frontier Lectures
AI Frontier Lectures
Mar 12, 2025 · Artificial Intelligence

Can Diffusion LLMs Replace Transformers? Inside Mercury Coder’s Speed Surge

The article analyzes the growing dissatisfaction with large language models, highlights generation speed as a critical bottleneck, compares the autoregressive approach with emerging diffusion LLMs, and examines Mercury Coder’s impressive token‑per‑second performance and its implications for the future of AI architecture.

AI architectureMercury CoderModel Speed
0 likes · 10 min read
Can Diffusion LLMs Replace Transformers? Inside Mercury Coder’s Speed Surge
Architect
Architect
Feb 24, 2025 · Artificial Intelligence

Inside MoBA: A Sparse Attention Framework for 10‑Million‑Token Contexts

The article details the development, architectural evolution, and practical challenges of MoBA—a sparse attention framework inspired by Mixture‑of‑Experts that scales LLM context length to 10 M tokens, supports seamless switching between full and sparse attention, and is now released as a minimal open‑source solution.

AI architectureContext ParallelLLM training
0 likes · 13 min read
Inside MoBA: A Sparse Attention Framework for 10‑Million‑Token Contexts
Architects' Tech Alliance
Architects' Tech Alliance
Feb 24, 2025 · Artificial Intelligence

NSA: Hardware‑Optimized Sparse Attention Mechanism from DeepSeek, Peking University and University of Washington

The NSA mechanism introduces a three‑branch hardware‑optimized sparse attention architecture—token compression, token selection, and sliding window—combined with learnable gating to balance global and local context, dramatically improving inference speed and efficiency for long‑context large language models.

AI architectureDeepSeekHardware Acceleration
0 likes · 5 min read
NSA: Hardware‑Optimized Sparse Attention Mechanism from DeepSeek, Peking University and University of Washington
Architect
Architect
Feb 16, 2025 · Artificial Intelligence

DeepSeek-V3, DeepSeek-R1, and Janus‑Pro: Architecture, Training Techniques, and Performance Insights

This article provides an in‑depth technical overview of DeepSeek‑V3, DeepSeek‑R1 and Janus‑Pro models, covering their Mixture‑of‑Experts architecture, novel MLA attention, auxiliary‑loss‑free load balancing, multi‑token prediction, FP8 mixed‑precision training, efficient cross‑node communication, reinforcement‑learning pipelines, multimodal modeling strategies, performance comparisons, cost statistics, and current limitations.

AI architectureDeepSeek-V3FP8 training
0 likes · 18 min read
DeepSeek-V3, DeepSeek-R1, and Janus‑Pro: Architecture, Training Techniques, and Performance Insights
Lao Guo's Learning Space
Lao Guo's Learning Space
Feb 15, 2025 · Artificial Intelligence

What Is deepseek-MoE? Understanding the Mixture‑of‑Experts Architecture

The article explains deepseek-MoE (Mixture of Experts), describing its full English name, Chinese translation, how a gating network selects and weights multiple expert models for each input, and uses an analogy to illustrate load‑balancing and the divide‑and‑conquer design in large AI models.

AI architectureLarge Language ModelsMixture of Experts
0 likes · 2 min read
What Is deepseek-MoE? Understanding the Mixture‑of‑Experts Architecture
IT Architects Alliance
IT Architects Alliance
Feb 8, 2025 · Artificial Intelligence

Inside DeepSeek: How Its Innovative Architecture Redefines AI Performance

This article examines DeepSeek's advanced Transformer‑based architecture, dynamic routing, MoE system, multi‑stage training, efficient inference, multimodal capabilities, real‑world applications, technical challenges, and future prospects, providing a comprehensive technical analysis of the model's strengths and limitations.

AI architectureDeepSeekModel Optimization
0 likes · 15 min read
Inside DeepSeek: How Its Innovative Architecture Redefines AI Performance
Infra Learning Club
Infra Learning Club
Feb 7, 2025 · Artificial Intelligence

Understanding LLM Agents: Architecture, Capabilities, and Key Challenges

This article explains what LLM agents are, their core components—brain, memory, planning, and tool use—illustrates how they handle complex queries through task decomposition, surveys notable frameworks, and discusses key challenges such as limited context, long‑term planning difficulties, output inconsistency, and prompt dependence.

AI architectureFrameworksLLM agents
0 likes · 15 min read
Understanding LLM Agents: Architecture, Capabilities, and Key Challenges
Alibaba Cloud Developer
Alibaba Cloud Developer
Feb 7, 2025 · Artificial Intelligence

Why DeepSeek V3 Achieves Low Training Costs: Inside Its AI Innovations

This article provides a comprehensive analysis of DeepSeek's large‑language‑model technology, covering the company's background, model capabilities, remarkably low training and inference costs, and the core architectural and algorithmic innovations such as MoE, MLA attention, FP8 mixed‑precision, and the DualPipe pipeline that enable efficient large‑scale AI deployment.

AI architectureDeepSeekFP8 training
0 likes · 19 min read
Why DeepSeek V3 Achieves Low Training Costs: Inside Its AI Innovations
Airbnb Technology Team
Airbnb Technology Team
Dec 12, 2024 · Artificial Intelligence

Airbnb Automation Platform v2: Enabling LLM‑Driven Conversational AI

Airbnb’s Automation Platform v2 replaces the rigid, workflow‑driven architecture of v1 with an LLM‑centric design that orchestrates context gathering, chain‑of‑thought reasoning, tool execution, and guardrails, enabling more natural, scalable, and safe conversational AI while preserving the reliability of traditional workflows.

AI architectureAirbnbConversational AI
0 likes · 11 min read
Airbnb Automation Platform v2: Enabling LLM‑Driven Conversational AI
DataFunSummit
DataFunSummit
Nov 27, 2024 · Artificial Intelligence

Applying Large Language Models in Data Management and Risk Control at Ping An One Wallet

This presentation details how Ping An One Wallet leverages large language models across five key areas—current application status, data management, risk control, technical architecture, and a Q&A session—highlighting strategies such as vectorized rule storage, prompt engineering, RAG enhancements, and workflow agents to improve efficiency and accuracy in data governance and fraud detection.

AI architectureData GovernanceVector Database
0 likes · 16 min read
Applying Large Language Models in Data Management and Risk Control at Ping An One Wallet
Tencent Docs Tech Team
Tencent Docs Tech Team
Nov 13, 2024 · Artificial Intelligence

Technical Architecture and Practices of the AI Document Assistant

This article explores the challenges large language models bring to efficiency tools, outlines the AI document assistant's technical thinking and architecture, and details both application‑side and model‑side practices such as retrieval‑augmented generation, intent recognition, and code‑driven table handling, concluding with key lessons.

AIAI architectureDocument Automation
0 likes · 16 min read
Technical Architecture and Practices of the AI Document Assistant
phodal
phodal
Oct 20, 2024 · Backend Development

Why Streaming BFF Is the Missing Glue for AI‑Native Apps

The article proposes a Streaming Backend‑for‑Frontend (BFF) layer to unify heterogeneous AI agents, handle Server‑Sent Events streams, and resolve interface inconsistencies, offering a practical architecture for generative‑AI‑native systems across IDEs, DevOps, and team‑AI scenarios.

AI architectureAPI DesignAgent Integration
0 likes · 13 min read
Why Streaming BFF Is the Missing Glue for AI‑Native Apps
JavaEdge
JavaEdge
Jun 23, 2024 · Artificial Intelligence

Mapping the Generative AI Landscape: From Infrastructure to Applications

This article provides a comprehensive overview of the generative AI industry, detailing its upstream foundation layer, midstream large‑model and tool layers, downstream application scenarios, and an extensive glossary of models, techniques, platforms, and concepts.

AI architectureIndustry Overviewgenerative AI
0 likes · 12 min read
Mapping the Generative AI Landscape: From Infrastructure to Applications
Baobao Algorithm Notes
Baobao Algorithm Notes
May 9, 2024 · Artificial Intelligence

Inside Deepseek‑V2: How Multi‑Head Latent Attention Cuts KV‑Cache and Boosts Performance

This article provides an in‑depth technical analysis of Deepseek‑V2, covering its 236B parameter size, Multi‑Head Latent Attention optimization that reduces KV‑cache memory, architectural details, training pipelines, infrastructure choices, and performance results on benchmarks such as MMLU and instruction following.

AI architectureDeepSeekModel Optimization
0 likes · 17 min read
Inside Deepseek‑V2: How Multi‑Head Latent Attention Cuts KV‑Cache and Boosts Performance
Architect
Architect
Apr 16, 2024 · Artificial Intelligence

Unraveling Sora: How OpenAI Might Build a 60‑Second Video Generator

This article dissects the possible architecture of OpenAI's Sora video model, tracing its visual encoder‑decoder, Spacetime Latent Patch, transformer‑based diffusion backbone, long‑time consistency strategies, and training pipeline, while comparing alternatives such as MAGVIT‑v2, TECO, NaViT, and FDM to reveal why each design choice may have been made.

AI architectureSoraTransformer
0 likes · 51 min read
Unraveling Sora: How OpenAI Might Build a 60‑Second Video Generator
DataFunTalk
DataFunTalk
Mar 21, 2024 · Artificial Intelligence

A Detailed Technical Analysis of Sora: Architecture, Key Components, and Potential Implementation

This article provides a comprehensive, easy‑to‑understand breakdown of Sora’s possible architecture—including its visual encoder‑decoder, Spacetime Latent Patch, transformer‑based diffusion model, long‑time consistency strategies, training techniques, and how it supports variable resolution and duration video generation.

AI architectureSoraSpacetime Patch
0 likes · 49 min read
A Detailed Technical Analysis of Sora: Architecture, Key Components, and Potential Implementation
JD Retail Technology
JD Retail Technology
Feb 28, 2024 · Artificial Intelligence

Edge AI at JD Retail: Architecture, Challenges, and Business Practices

This article details JD Retail's edge AI (on‑device intelligence) platform, covering its definition, performance and security challenges, three‑layer cloud‑edge‑device architecture, key components such as high‑performance inference engine, data pipeline, Python VM container, and real‑world applications in traffic distribution and image recognition.

AI architectureJD Retailedge AI
0 likes · 15 min read
Edge AI at JD Retail: Architecture, Challenges, and Business Practices
Smart Era Software Development
Smart Era Software Development
Jul 26, 2023 · Artificial Intelligence

Three Core Skills Every Aspiring AI Architect Needs

The article defines the AI architect role and outlines three essential capabilities—mastery of AI technologies and development workflow, deep business understanding with strong abstraction ability, and the design and implementation of efficient, scalable AI solutions—explaining why each is critical for successful AI product delivery.

AI architectureBusiness AnalysisModel deployment
0 likes · 10 min read
Three Core Skills Every Aspiring AI Architect Needs
HomeTech
HomeTech
Jul 26, 2023 · Artificial Intelligence

Practical Implementation of ChatGPT Technology Products: Architecture, Prompt Engineering, and Future Challenges

This article explores the practical deployment of ChatGPT‑based products, detailing the model fundamentals, technical architecture, engineering‑focused prompt design, real‑world application scenarios, and the challenges of model generalization, resource consumption, data privacy, interpretability, and ethical considerations.

AI architectureChatGPTData Analysis
0 likes · 15 min read
Practical Implementation of ChatGPT Technology Products: Architecture, Prompt Engineering, and Future Challenges
Smart Era Software Development
Smart Era Software Development
Jun 25, 2023 · Artificial Intelligence

What Emerging Architectures Power Modern LLM Applications?

This article outlines a reference stack for LLM applications, detailing the context‑learning design pattern, key components such as vector databases and embedding models, orchestration frameworks like LangChain, and discusses trade‑offs between proprietary and open‑source models, scaling challenges, and the future role of AI agents.

AI architectureContext LearningEmbedding
0 likes · 17 min read
What Emerging Architectures Power Modern LLM Applications?
phodal
phodal
Jun 2, 2023 · Artificial Intelligence

Mastering LLMs: A Programmer’s Guide to Prompt Engineering, Architecture, and Contextual AI

This comprehensive guide walks programmers through the fundamentals of large language model capabilities, prompt writing and management, new interaction and workflow designs, advanced scenario‑specific applications, and context engineering, offering practical strategies and architectural insights for AI‑native development.

AI architectureContext EngineeringLLM
0 likes · 14 min read
Mastering LLMs: A Programmer’s Guide to Prompt Engineering, Architecture, and Contextual AI
Architects' Tech Alliance
Architects' Tech Alliance
May 15, 2023 · Artificial Intelligence

How Transformer Powers ChatGPT: A Deep Dive into Attention and Architecture

This article provides a comprehensive analysis of the Transformer model behind ChatGPT, covering its origin, core mechanisms such as embedding, positional encoding, self‑attention, multi‑head attention, a step‑by‑step translation example, and the broader implications for AI research and industry.

AI architectureAttention MechanismChatGPT
0 likes · 19 min read
How Transformer Powers ChatGPT: A Deep Dive into Attention and Architecture
DataFunSummit
DataFunSummit
Mar 30, 2023 · Artificial Intelligence

An Overview of ChatGPT’s Software Architecture and Technology Stack

The article examines ChatGPT’s underlying software architecture, detailing its cloud deployment on AWS and Azure, database choices like PostgreSQL and Redis, front‑end technologies such as TypeScript and React, core AI frameworks including PyTorch and Triton, as well as its container orchestration, monitoring, and programming language ecosystem.

AI architectureChatGPTDatabases
0 likes · 6 min read
An Overview of ChatGPT’s Software Architecture and Technology Stack
21CTO
21CTO
Feb 8, 2023 · Artificial Intelligence

Understanding ChatGPT: Architecture, Training, Limitations, and Future Directions

This article provides a comprehensive overview of ChatGPT, covering its origin, core GPT‑3.5 architecture, RLHF training pipeline, distinctive features, current limitations, and emerging research directions such as model compression and integration with symbolic engines.

AI architectureArtificial IntelligenceChatGPT
0 likes · 18 min read
Understanding ChatGPT: Architecture, Training, Limitations, and Future Directions
Alibaba Cloud Developer
Alibaba Cloud Developer
Sep 3, 2019 · Artificial Intelligence

Unlocking Scalable Private‑Domain Recommendations with a “4+N” Architecture

This article describes a systematic, standardized, and automated “4+N” recommendation framework that unifies features, samples, models, and pipelines to accelerate private‑domain marketing recommendations across multiple scenarios while improving accuracy, efficiency, and business impact.

AI architectureModel deploymentPrivate Domain
0 likes · 12 min read
Unlocking Scalable Private‑Domain Recommendations with a “4+N” Architecture