Machine Heart
Machine Heart
Apr 29, 2026 · Artificial Intelligence

Boost Black-Box VLMs Without Training: Class-Aware Prompt Reweighting (CARPRT)

The article analyzes the prompt‑sensitivity problem of zero‑shot classification in vision‑language models, critiques class‑agnostic prompt weighting, and presents CARPRT—a training‑free, black‑box compatible method that reweights prompts per class using similarity scores and pseudo‑labels, achieving consistent gains across datasets and model architectures.

Black-Box OptimizationClass-Aware ModelingPrompt Reweighting
0 likes · 11 min read
Boost Black-Box VLMs Without Training: Class-Aware Prompt Reweighting (CARPRT)