1 views collected around this technical thread.
The article explains the true nature of the compound effect in learning, outlining its financial origins, three essential elements, why many potential compounds fail, and four mechanisms—continuous use, transfer, feedback, and connection—that enable knowledge to generate lasting, exponential growth.
This article provides a comprehensive overview of DeepSeek's model distillation technology, detailing its definition, key innovations, architecture, training methods, performance gains, and the remaining challenges such as the implicit performance ceiling and multimodal data distillation.
This article provides an in‑depth overview of DeepSeek’s model distillation technology, covering its definition, core principles, innovative data‑model distillation integration, architecture design, training strategies, performance gains, and the challenges of scaling to multimodal data.
The article explains DeepSeek's model distillation technique, covering its fundamental knowledge‑transfer principles, unique innovations such as data‑model fusion and task‑specific strategies, impressive benchmark results, practical applications in edge and online inference, existing challenges, and future research directions.
This presentation reviews recent research on data security and utilization in the large‑model era, covering privacy‑preserving federated learning, knowledge‑transfer techniques, prototype‑based modeling, multi‑model fusion methods such as FuseGen, and introduces the federated knowledge computing platform FLAIR for both horizontal and vertical federated scenarios.
This article presents an overview of graph knowledge transfer, discussing the data‑hungry problem, distribution shift in graph data, the Knowledge Bridge Learning (KBL) paradigm, the Bridged‑GNN implementation, experimental results across multiple scenarios, and future research directions.
This article presents a comprehensive overview of graph knowledge transfer, covering its definition, the data‑hungry problem, distribution shift challenges, the Knowledge Bridge Learning (KBL) framework, the Bridged‑GNN model, extensive experiments on real‑world scenarios, and a concluding Q&A session.
This paper presents a novel framework that leverages negative samples during large language model distillation through three stages—Negative Assistive Training, Negative Calibration Enhancement, and Adaptive Self‑Consistency—demonstrating significant accuracy gains on challenging mathematical reasoning benchmarks and improved generalization to out‑of‑distribution tasks.
This article reviews recent advances in graph transfer learning, introduces the novel VS-Graph scenario for knowledge transfer between dominant and silent nodes, and details the Knowledge Transferable Graph Neural Network (KTGNN) framework with domain‑adaptive feature completion, message passing, and transferable classifier modules, highlighting experimental results and future research directions.