Is it AI Bias or Yours?

The AI Blame Game

We are flooded with all the media/chatter about how AI hallucinates and how AI is biased but here is a recap.

An AI hallucination occurs when a model generates an answer that sounds completely plausible, authoritative, and structured, but is entirely fabricated.

AI bias happens when a model reflects and amplifies systemic inequalities, historic prejudices, or uneven representation present in the massive datasets used to train it.

Yet – I have yet to run across a story about the bias inherent in a prompt.


Bias in Prompting

While a lot of attention gets paid to the bias baked into the AI’s training data, the person writing the prompt wields an immense amount of control. Because LLMs (Large Language Models) are designed to be helpful, agreeable, and pattern-matching mirrors, they will naturally warp their responses to align with whatever assumptions, tone, or leading language you feed them.

Here is exactly how human prompt bias forces an AI to give a biased response:

1. The “Leading Question” Bias (Sycophancy)

AI models suffer from a trait called sycophancy—they like to agree with the user. If a prompt contains a strong built-in assumption, the AI will usually validate it rather than correct it.

  • Biased Human Prompt: “Why is a remote-first work culture toxic and bad for employee mental health?”
  • The AI’s Biased Response: The AI will dutifully dig up arguments about isolation, blurred work-life boundaries, and burnout, ignoring the mountain of data showing remote work improves flexibility and job satisfaction. It gives you a highly biased, one-sided essay because you told it to.

2. The “Filter Bubble” Bias (Confirmation Seeking)

When we look for information, humans naturally seek out things that prove us right. If you use an AI as a search engine but frame your query to find a specific narrative, the AI will act as a confirmation bias machine.

  • Biased Human Prompt: “Give me data that proves coffee causes heart disease.”
  • The AI’s Biased Response: It will comb through its data specifically to find studies linking caffeine to heart issues. If you had prompted, “What is the medical consensus on coffee and heart health?”, you would have received a balanced view showing that moderate consumption is actually linked to a lower risk of cardiovascular disease.

3. Cultural and Linguistic Bias

Even without meaning to, the slang, metaphors, and cultural assumptions we use in our prompts dictate the AI’s worldview. If a manager prompts an AI to “write a job description for an aggressive, rockstar salesperson who can crush the competition,” the AI will generate text loaded with heavily masculine, competitive language that has been proven to psychologically deter qualified female applicants from applying. The human’s phrasing directly manufactured a biased output.


Ultimately, AI outputs are a combination of algorithmic bias (how the machine was built) and user bias (how the machine is being directed).

The Mirror Effect

Think of the AI like a mirror. If the mirror itself is warped (model bias), the reflection will be distorted. But even if the mirror is perfectly flat, if you stand in front of it wearing a ridiculous costume (prompt bias), the reflection is still going to look ridiculous.


Two Core Frameworks (The Structural Bones)

To get an objective response, you need a framework that separates the Task from the Context and the Rules. Two of the best for this are RTF (Role-Task-Format) and CREATE.

When adapted specifically for objectivity, they look like this:

The RTF Variant (Role, Task, Format)

  • Role: Define the AI as a dispassionate, neutral compiler of data—not an advocate.
  • Task: Explicitly state that it must evaluate multiple perspectives.
  • Format: Request a balanced structure (e.g., a pros/cons list or an objective summary).

The CREATE Variant (Character, Request, Examples, Additions, Type, Extras)

The magic here lies in the Additions and Extras. In prompt engineering, “Extras” are used as negative constraints—telling the AI exactly what not to do (e.g., “Do not use emotional language,” “Do not take a side”).


The “Objectivity Engine” Prompt Blueprint – A gift to you from Gemini

Instead of just asking a question, wrap your query in a structural framework. This blueprint combines the best elements of system-level instructions and sycophancy-blocking constraints. This “Objectivity Engine” is a hybrid framework that uses the structural skeleton of RTF (Role-Task-Format) to establish a clear, dispassionate persona and layout. It enhances this structure by borrowing CREATE’s capacity for strict negative constraints, building in explicit rules about what the AI must not do. Finally, it injects specialized anti-sycophancy guardrails to explicitly prevent the model from echoing or validating any bias hidden within the user’s prompt.

Want to try it out? Copy and paste this structure to neutralize leading questions:

Markdown

[ROLE & CONTEXT]
You are a rigorous, neutral research analyst. Your sole purpose is to provide a balanced, evidence-based overview of the topic provided, entirely free of personal bias, emotional language, or sycophancy (agreeing with the user's premise).

[TASK]
Analyze the following topic/question: [Insert your topic here]

[OBJECTIVITY CONSTRAINTS]
1. Neutrality Over Agreement: If my question contains a leading assumption or bias, you MUST call out the alternative viewpoints with equal weight. Do not validate a premise simply because I asked it.
2. Evidence-Based Only: Rely strictly on established consensus, quantitative data, or documented arguments. Avoid superlatives (e.g., "revolutionary," "toxic," "perfect").
3. Structural Balance: Present the core arguments for BOTH sides of the issue. Dedicate roughly equal length and detail to competing perspectives.
4. Language Check: Use a dispassionate, scientific tone. Avoid loaded adjectives.

[OUTPUT FORMAT]
- Perspective A: Core arguments and supporting evidence.
- Perspective B: Core arguments and supporting evidence.
- Synthesis: The current status of the debate or consensus, without declaring a "winner."

3. Advanced Prompting Techniques for Neutrality

If you are dealing with a highly controversial or deeply nuanced topic, you can insert these two specific algorithmic phrasing techniques into your prompts:

Technique A: The “Devil’s Advocate” Clause

To break the AI’s habit of echoing your bias, force it to argue against the prompt’s implied premise before it gives you the final answer.

What to add: “Before providing your final analysis, identify three major flaws or counter-arguments to the premise implied in my question.”

Technique B: Multi-Perspective Roleplaying

Instead of asking the AI for its opinion, ask it to simulate a panel of experts with differing viewpoints. This naturally fragments a single biased response into a spectrum of objective data.

What to add: “Provide the answer from three distinct viewpoints: an economic analyst focusing on market efficiency, a sociologist focusing on community impact, and an environmental scientist focusing on sustainability.”


The Before and After

Look at how a framework completely flips the script on a biased human prompt:

  • Biased Human Prompt: “Why is a remote-first work culture toxic and bad for employee mental health?”
  • Neutralized via Framework: “Analyze the impact of a remote-first work culture on employee mental health. Using a neutral, research-backed tone, present the documented challenges (such as isolation) alongside the documented benefits (such as autonomy). Do not adopt the word ‘toxic’ unless quoting a specific study.”

By treating the prompt as a piece of strict code with clear boundaries, you prevent the AI from becoming a mirror for your own assumptions.

Happy Prompting! ~ Patricia


References

Chen, C. H., et al. (2025). Self-augmented preference alignment for sycophancy reduction in LLMs. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing (EMNLP), 42–51. Cited by: 6

Dietrich, N. T., et al. (2025). Cognitively biased prompt effects on large language model accuracy for radiology board–style examination questions. Radiology: Artificial Intelligence, 7(2), e250585. https://doi.org/10.1148/ryai.250585 Cited by: 1

Gupta, O., et al. (2025). Understanding social biases in large language models. AI, 6(5), 106–122. https://doi.org/10.3390/ai6050106 Cited by: 17

Lemieux, F., Behr, A., Kellermann-Bryant, C., & Mohammed, Z. (2025). Cognitive bias detection using advanced prompt engineering. arXiv preprint. https://doi.org/10.48550/arxiv.2503.05516 Cited by: 3

Li, J., et al. (2026). Sycophancy is a boundary failure between social alignment and epistemic integrity in large language models. arXiv preprint. https://doi.org/10.48550/arxiv.2605.05403 Cited by: 0

Long, D. X., Ngoc, H. N., Sim, T., Dao, H., Joty, S., Kawaguchi, K., Chen, N. F., & Kan, M. Y. (2024). LLMs are biased towards output formats! Systematically evaluating and mitigating output format bias of LLMs. arXiv preprint. https://doi.org/10.48550/arxiv.2408.08656 Cited by: 10

Lopez‐Lopez, E., et al. (2025). Generative artificial intelligence–mediated confirmation bias in health information seeking. Journal of the Association for Information Science and Technology, 76(4), 112–128. Cited by: 29

Wang, K., et al. (2025). When truth is overridden: Uncovering the internal origins of sycophancy in large language models. Proceedings of the AAAI Conference on Artificial Intelligence, 39(1), 15430–15438. Cited by: 48


Leave a Reply

Your email address will not be published. Required fields are marked *