Can Model Weights Serve as the Next Training Data for AI?
As high‑quality text and image datasets near exhaustion, researchers explore "weight‑space learning"—treating trained neural‑network parameters as a learnable data modality—to extract knowledge from existing models, evaluate its feasibility, and identify challenges such as generation quality, geometry, and data collection.
