Why Asking Users About Their Feelings Can Mislead Your Research—and What to Ask Instead

UX practitioners often start by asking users how they feel about a product, but academic research considers this approach insufficiently rigorous and prone to bias.

1. Why Not Ask Users About Their "Feelings"

When respondents are asked for their opinion, they tend to give polite, superficial answers due to social desirability and habitual brain patterns, leading to inaccurate insights. Neuroscience shows that intuition and the "old brain" can produce misleading responses, and memory biases such as the availability heuristic further distort recollection.

Instead of seeking aesthetic judgments, researchers should uncover real problems users encounter in their daily lives, following the principle: "Users provide problems, experts provide solutions."

2. Focus on What Users Did, Not What They Think

As CEO Fu Sheng of Cheetah Mobile said, "Phenomena are truth." The ultimate indicator of user sentiment is actual purchase behavior, not expressed feelings. Analyzing concrete actions—what users actually did in real contexts—yields deeper value than speculative opinions.

Questions about why users didn’t act or what they might do in the future are unreliable because people cannot accurately recall past contexts or predict future behavior.

3. Break Traditional Academic Rules: You Can Ask Users How They Think

Steve Krug’s "Rocket Surgery" and guerrilla testing in coffee shops demonstrate that unconventional methods can still gather useful insights quickly. While qualitative research has been criticized by quantitative scholars, experienced researchers with backgrounds in psychology, anthropology, or sociology can mitigate bias and interpret feelings meaningfully.

Lean UX literature (e.g., Laura Klein’s book) shows that asking users how they would design can surface unexpected, valuable ideas. In agile teams, iterative research combined with quantitative validation offers a pragmatic alternative to exhaustive academic studies.

For beginners, it is advisable to follow traditional interview protocols first, concentrating on observable user actions before experimenting with more innovative techniques.

In summary, leveraging interdisciplinary knowledge, focusing on real behaviors, and applying agile, evidence‑based methods enable more reliable user research while still valuing the nuanced insights that users’ feelings can provide.