Tagged articles
8 articles
Page 1 of 1
Machine Heart
Machine Heart
May 17, 2026 · Artificial Intelligence

Why Do Large Language Models Speak and Reason Like Humans? An In‑Depth Look at Their Mechanisms

This article examines how large language models acquire human‑like language and reasoning abilities by learning statistical patterns, employing next‑token prediction, feature superposition, sparse autoencoders, and function‑token memory mechanisms, and compares their internal processes with human cognition, highlighting both breakthroughs and remaining limitations.

Artificial IntelligenceFeature SuperpositionLLM Interpretability
0 likes · 24 min read
Why Do Large Language Models Speak and Reason Like Humans? An In‑Depth Look at Their Mechanisms
IT Services Circle
IT Services Circle
Mar 26, 2026 · Artificial Intelligence

Why OpenClaw Is the Hottest AI Agent and How It Works Under the Hood

OpenClaw is a 24/7 autonomous AI agent that runs locally, offering multi‑platform integration, high‑permission file and command access, a plug‑in skill ecosystem, self‑correcting memory, and a transparent markdown‑based workspace, while also exposing its architectural components, directory layout, and trade‑offs such as security risks and token consumption.

AI AgentAutonomous AILocal Execution
0 likes · 27 min read
Why OpenClaw Is the Hottest AI Agent and How It Works Under the Hood
Data Party THU
Data Party THU
Feb 4, 2026 · Artificial Intelligence

How Sakana AI Redefines Long-Context Transformers: DroPE, REPO, and FwPKM Explained

This article analyzes Sakana AI's three recent papers that challenge traditional Transformer long‑sequence handling by removing positional embeddings, reconstructing position awareness, and adding a fast‑weight external memory, showing how each approach improves ultra‑long text understanding.

Memory MechanismPositional EmbeddingTransformer
0 likes · 12 min read
How Sakana AI Redefines Long-Context Transformers: DroPE, REPO, and FwPKM Explained
DataFunSummit
DataFunSummit
Dec 12, 2024 · Artificial Intelligence

Exploring Generative Retrieval: Memory Mechanisms, GDR Paradigm, and Practical Applications

This presentation examines generative retrieval (GDR), compares it with sparse and dense retrieval paradigms, analyzes memory‑mechanism challenges from an EACL 2024 paper, reports experimental findings, proposes a hybrid GDR‑dense approach, and outlines real‑world application scenarios and future directions.

GDRGenerative RetrievalMemory Mechanism
0 likes · 13 min read
Exploring Generative Retrieval: Memory Mechanisms, GDR Paradigm, and Practical Applications
DataFunSummit
DataFunSummit
Jul 17, 2024 · Artificial Intelligence

Overview of LLM‑Based Agents: Architecture, Key Challenges, and Future Directions

This article reviews the emerging field of large‑language‑model (LLM) based AI agents, outlining their overall architecture, core modules such as profiling, memory, planning and action, discussing current challenges, presenting concrete use‑cases, and highlighting promising research directions.

AI AgentAgent ArchitectureLLM
0 likes · 11 min read
Overview of LLM‑Based Agents: Architecture, Key Challenges, and Future Directions
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Apr 28, 2024 · Artificial Intelligence

Generative Dense Retrieval: Memory Can Be a Burden

The paper introduces Generative Dense Retrieval (GDR), a two‑stage retrieval framework that first maps queries to memory‑efficient document‑cluster identifiers and then uses dense vectors to locate individual documents, achieving higher recall and better scalability than traditional generative retrieval while incurring modest latency and capacity trade‑offs.

Memory Mechanismgenerative dense retrievalinformation retrieval
0 likes · 13 min read
Generative Dense Retrieval: Memory Can Be a Burden
NewBeeNLP
NewBeeNLP
Apr 15, 2024 · Artificial Intelligence

Unlocking LLM‑Based Agents: Architecture, Challenges, and Future Directions

This article systematically outlines the architecture of large‑language‑model (LLM) agents, examines their key technical challenges such as role‑playing, memory design, reasoning and multi‑agent collaboration, and explores emerging research directions and practical case studies.

AIFuture DirectionsLLM agents
0 likes · 11 min read
Unlocking LLM‑Based Agents: Architecture, Challenges, and Future Directions
DataFunTalk
DataFunTalk
Apr 8, 2024 · Artificial Intelligence

LLM‑Based Agents: Architecture, Key Challenges, and Future Directions

This article surveys the emerging field of large‑language‑model (LLM) based agents, detailing their modular architecture—including profiling, memory, planning, and action components—while discussing critical challenges such as role‑playing, memory design, reasoning, multi‑agent collaboration, and outlining promising research directions and practical case studies.

AI AgentAgent ArchitectureLLM
0 likes · 11 min read
LLM‑Based Agents: Architecture, Key Challenges, and Future Directions