R&D Management 5 min read

Paper Rebuttal Tip #12: Stop Just Promising—Provide Immediate Results

When reviewers criticize missing experiments or analysis, the most persuasive rebuttal avoids empty promises and instead supplies concrete new results, detailing the experimental setup, key numbers, and how these findings reinforce the paper's original conclusions.

Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Paper Rebuttal Tip #12: Stop Just Promising—Provide Immediate Results

Problem

Reviewers often note that a paper lacks a critical experiment or analysis, making the current evidence insufficient to support the conclusions.

Ineffective reply

Simply stating “We will add it in the revised version” provides no persuasive power during the rebuttal phase.

What reviewers actually care about

Whether the supplementary experiment has been performed.

The experimental setup.

The core results.

Whether the new results uphold the original claim.

Whether the results fill the identified gaps.

Recommended reply

If time permits, include the new experiment or analysis results directly in the rebuttal.

Thank you for the valuable suggestion. We agree that this analysis is crucial for validating our method. Based on your feedback, we have added an experiment that partitions the test set by sample difficulty (easy, medium, hard) and compares our method with the strongest baselines. The results show a markedly larger improvement on hard samples, indicating that our method’s advantage persists in more challenging scenarios. We will incorporate these results into the revised manuscript and discuss the underlying reasons in the analysis section.

Three practical steps

State what was added: e.g., experiments split by task type, sample difficulty, model scale, or data size.

Provide key numbers or trends: e.g., “On difficult samples, our method outperforms the strongest baseline by X%,” or “The gain remains stable at larger model scales.”

Explain how the new results support the main claim: e.g., “These findings demonstrate that the advantage is not limited to easy cases but holds under challenging conditions.”

One‑sentence takeaway

Do not merely say “we will add it”; if possible, present the essential new results now, including the experimental setup, core metrics, and the conclusion they reinforce.

Project address

GitHub repository: https://github.com/MLNLP-World/Paper-Rebuttal-Tips

Original Source

Signed-in readers can open the original source through BestHub's protected redirect.

Sign in to view source
Republication Notice

This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactadmin@besthub.devand we will review it promptly.

NLPacademic writingresearch tipspaper rebuttalreview response
Machine Learning Algorithms & Natural Language Processing
Written by

Machine Learning Algorithms & Natural Language Processing

Focused on frontier AI technologies, empowering AI researchers' progress.

0 followers
Reader feedback

How this landed with the community

Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.