Debugging LLM Adapter Parameter Passing: Config vs. Generate Call Mismatch
The article reveals how LLM generation parameters like repetition_penalty and no_repeat_ngram_size can be lost in adapter layers, showing through local HF and API provider case studies that configuration dictionaries often don't fully propagate to the actual generate call, and emphasizes verifying parameters at the call boundary rather than trusting logs.
