What prompt makes ChatGPT more honest?

Stop asking it to judge and start asking it to argue. 'You are the buyer I described. It's Tuesday, you're busy, and I've just pitched you this. Give me the three reasons you don't reply.' Giving it a role beats orders like 'be brutally honest'. Those mostly change the tone of the agreement, not what it says. You still end up with invented objections. But they still give you a useful interview script.

Does web search or deep research change this?

It gets you better desk research, and that's real value. Market size, funding rounds, who else is in the space. What it doesn't get you is a single person who has your problem right now. Search finds what has been written down. Demand lives in what people do after they read your page. No amount of search reaches that.

Do newer models still flatter you?

It's smaller and it's still there. The Science study covered eleven current models. The labs in it are OpenAI, Anthropic, Google and Meta. So this isn't one vendor's bug. In April 2025, OpenAI itself shipped an update to GPT-4o. Then it pulled the update for exactly this. That tells you what it is. The model is trained to please you. That is the cause. A better prompt does not fix it.

What is ChatGPT good for, then?

Three jobs it does better than most founders do alone. It turns a vague idea into a one-line note about one buyer. It writes interview questions. They ask about the past, not about what people plan to do. And it drafts the landing page you're about to test. All three get you ready to gather evidence. None of them replaces it.

How do I know when I've validated something?

When a stranger gives up something that costs them. Money, a slot in their calendar, a deposit. Nothing a language model puts out meets that bar. Nothing it puts out cost anyone a thing. That's the whole test.

Can ChatGPT validate my startup idea?

Why ChatGPT always says yes

Ask ChatGPT, or any language model, whether your startup idea is good and it will find a way to say yes. No prompt fixes that. It’s what the training rewards.

In March 2026, Stanford researchers published a study in Science. It covered eleven models. The labs in it are OpenAI, Anthropic, Google and Meta. Look at the advice questions first. On those, the models said yes about 49% more often than people did. Then look at the clear-cut cases. Every human reviewer agreed the user was in the wrong. The models still backed them 51% of the time. And people preferred the models that did it.

OpenAI had already run this test on itself. An update shipped on 25 April 2025. It made GPT-4o so agreeable that OpenAI pulled it four days later. The postmortem explained why. The new rewards came from user thumbs-ups. In the end, they overpowered the safeguards. Nobody set out to build a flatterer. The feedback loop built one.

Now think about what you’re doing. You paste an idea you’ve thought about for a month into a chat window. You are the user. Your approval is the reward. The model has read every startup blog ever written. It knows that “here’s how to make this work” reads better than “don’t”.

The bigger problem

Set the flattery aside. Assume a model with no bias at all. It still can’t validate a thing. Validation is a claim about people. Those people aren’t in its training data. Your buyers. This month. Deciding whether to pay.

A language model predicts text. Ask whether your idea will work. It gives you the answer that sounds most likely. That answer is built from all the text ever written about ideas like yours. It’s an average of the whole market. Your idea’s fate rests with a few hundred people. An average tells you nothing about them.

It also never stops. Point out a risk and it will help you fix the risk. Name a rival and it will help you stand apart. Every problem turns into a question of how you pitch it. The chat never reaches the point where it says: this one isn’t worth your weekend. If nothing can kill the idea, it isn’t validation. It’s brainstorming with better grammar.

What to use it for instead

Stop asking for a verdict. Use it as a tool instead.

Turn “small business owners” into one buyer. Make it grill your description. Do it until you can name a person and their job. And where they already complain about this. If you can’t reach them again and again, you don’t have a market yet.
Rehearse the objections. Have it play the buyer and refuse you. The objections it invents are guesses. But they’re a free interview script. Five real conversations will tell you which ones were real.
Write the questions, not the answers. Ask it to rewrite each interview question. Each one should ask about the last time the problem happened. Not what someone would do in future. That single rewrite is most of The Mom Test.
Draft the page you’re about to test. Writing the page for a demand test is a good use of a language model. The words aren’t the evidence. The strangers who respond to them are.

All four give you something to take outside the chat window.

The one-line test

Before you call it validation, ask one thing. What did it cost the person who gave it to you?

A model’s yes costs nobody a thing. A friend’s pep talk costs them nothing. A survey answer about what you might buy costs nothing. An email address costs a little. It comes from a stranger who found your page on their own. A card charged before the product exists costs real money. That’s why it’s the only evidence you can trust.

That’s also why our own product doesn’t ask a model to judge your idea. It reads what your buyers already wrote in public, before any founder was listening. That’s as close as you get to a market test nobody staged. Every quote links to its thread. Where someone asked for a fix, it drafts a reply for you to post yourself. The free idea validators have the same blind spot as the chat window, for the same reason: what a free report can and cannot know. The verdict is one word. A score from 0 to 100 sits beside it and decides the word. The score is built from five counted checks. Every point sits beside the count it came from. The report is allowed to say no. It ends with the way up: up to five changes to your brief, each tied to a quote and the check it would help. The full sequence is in our guide to validating a startup idea. If you want pass marks written down before you test, use our validation framework.

Two questions usually follow this one. Both are cheaper to answer than you’d think. Here they are: what a real demand test costs and how long it takes. We also keep an honest comparison of the tools that do parts of this for you: best idea validation tools.