GEO Lab #03 · S3-CHATGPT-V1-R1 · Original response
This page presents one selected response from GEO Lab #03. It adds a smaller reading and citation entry point; it does not replace the full archive or collect a new answer.
The OpenAI arm uses the Responses API with web search and does not represent consumer ChatGPT Search. Grok records identify their actual consumer-interface mode and available model label.
Recorded conditions
Original prompt
I'm a solo SaaS founder with no GEO budget. How can I tell whether an AI visibility score for ChatGPT and Grok is trustworthy?
The agreed prompt is reproduced exactly. Any recorded difference in the actual submitted text or search UI is retained in the raw record and full appendix.
Original answer
**Short answer:** don’t trust the number itself. Trust it only when you can audit the prompts, settings, raw answers, and calculation behind it. Generative answers vary even when the input is unchanged, so a single query—or a mysterious 0–100 score—is not a reliable measurement. OpenAI’s own evaluation guidance recommends task-specific tests, logging everything, continuous evaluation, and combining numerical metrics with human judgment. ([platform.openai.com](https://platform.openai.com/docs/guides/evaluation-best-practices)) ## An 8-point trust test Give the tool one point for each item: 1. **Exact prompts are visible** You should see every query used. Most should be unbranded buyer questions, such as “best invoicing tool for freelancers,” not questions containing your company name. 2. **The prompt set stays fixed** If prompts change every scan, score changes may reflect different questions rather than improved visibility. 3. **Raw answers are available** You should be able to inspect the full response, citations, timestamp, competitors mentioned, and your position—not just a dashboard percentage. 4. **The product surface is identified** “ChatGPT” is insufficient. Was it the consumer app or API? Was search enabled? Was the session personalized? What location was used? ChatGPT can automatically search, rewrite queries, and use approximate location or memory, all of which can affect results. ([help.openai.com](https://help.openai.com/en/articles/9237897-chatgpt-search)) 5. **Grok’s retrieval mode is identified** The vendor should disclose whether Grok used no retrieval, web search, X search, or both. xAI documents these as separate tools, and current information is unavailable through its API models unless search tools are enabled. ([docs.x.ai](https://docs.x.ai/docs/guides/live-search)) 6. **Exact model/version and date are logged** Avoid results labeled merely “latest.” xAI’s aliases can automatically migrate to newer versions, while dated model IDs are intended for consistent workflows. ([docs.x.ai](https://docs.x.ai/docs/models)) 7. **Prompts are run repeatedly** The report should show a denominator such as “mentioned in 7 of 30 runs,” not merely “23% visibility.” One run per prompt is a snapshot, not a dependable trend. 8. **The formula is public and decomposable** You should separately see: - Unprompted mention rate - Citation rate - Recommendation position - Factual accuracy - Competitor share of voice A blended score should show its weights. Otherwise, a high score could hide zero citations or inaccurate descriptions. ### Interpretation - **7–8 points:** trustworthy for tracking trends - **5–6 points:** directional only - **0–4 points:** primarily a marketing metric Even an 8/8 score estimates visibility for its chosen prompt panel—not visibility across all real ChatGPT or Grok users. ## Free DIY validation Create ten prompts based on actual buying situations: - Four category-discovery prompts - Three “alternatives to…” prompts - Two problem-to-solution prompts - One branded prompt for factual accuracy Run each prompt **three times in ChatGPT and three times in Grok**, using fresh, unpersonalized conversations where possible. That is 60 responses per monthly check. Track this in a spreadsheet: | Date | Engine | Search mode | Prompt | Run | Mentioned? | Position | Own domain cited? | Other source cited? | Accurate? | |---|---|---|---|---:|---|---:|---|---|---| Calculate: ```text Unprompted mention rate = unbranded runs mentioning you / unbranded runs Citation rate = runs citing your domain / total runs Top-3 rate = runs listing you among first 3 recommendations / total runs Accuracy rate = audited claims that are correct / claims audited ``` Keep ChatGPT and Grok separate. Their retrieval mechanisms and product surfaces differ, so averaging them can hide useful information. ## How to spot-check a vendor Ask for five randomly selected observations, then rerun those prompts yourself with matching settings. You should not expect identical wording. You should expect roughly similar: - Brand inclusion frequency - Competitors named - Sources cited - General recommendation position If the vendor cannot provide the **prompt, raw answer, timestamp, model, search mode, and location/account context**, consider the score unverifiable. ## Biggest red flags - “Proprietary methodology” with no formula - One run per prompt - Prompts containing your brand mixed with unbranded prompts - API results presented as consumer-app visibility - No distinction between search-on and search-off answers - No raw responses or citations - Score changes without sample counts - Comparing your score across unrelated industries - Recommendations optimized to increase the vendor’s own score - Claims that a small decimal movement proves an improvement **Bottom line:** with no budget, your fixed 10-prompt spreadsheet is more useful than a sophisticated opaque score. Track stable, auditable rates monthly and treat referral traffic, trials, and customer-reported discovery as the ultimate validation.
Recorded sources
These are the source roles recorded in the public dataset. A retrieval or source-panel item is not automatically an answer-body citation. A URL supplied in the prompt and repeated by an answer does not prove content access. No destination has been repaired or independently validated here.
Recorded answer-body links (4)
- Evaluation best practices | OpenAI APIAPI body url_citation annotation · platform.openai.com
- Searching the web with ChatGPT | OpenAI Help CenterAPI body url_citation annotation · help.openai.com
- Web Search | SpaceXSI DocsAPI body url_citation annotation · docs.x.ai
- Grok Models & Pricing | SpaceXSI DocsAPI body url_citation annotation · docs.x.ai
Retrieval-only / source-panel inventory (45)
- https://help.openai.com/en/articles/10093903-chatgpt-search-for-enterprise-and-eduretrieval source, not automatically a body citation · help.openai.com
- https://llm-visibility-index.com/methodology/retrieval source, not automatically a body citation · llm-visibility-index.com
- https://citations.io/docsretrieval source, not automatically a body citation · citations.io
- https://help.openai.com/en/articles/8313428-does-chatgpt-tell-the-truth%3F.plsretrieval source, not automatically a body citation · help.openai.com
- https://openai.com/academy/search-and-deep-research/retrieval source, not automatically a body citation · openai.com
- https://visibilityradar.ai/methodologyretrieval source, not automatically a body citation · visibilityradar.ai
- https://www.generaldataworks.com/ai-visibility/methodologyretrieval source, not automatically a body citation · www.generaldataworks.com
- https://www.temso.ai/rankings/methodologyretrieval source, not automatically a body citation · www.temso.ai
- https://www.theaivisibilityindex.ai/faqretrieval source, not automatically a body citation · www.theaivisibilityindex.ai
- https://recosignal.com/methodologyretrieval source, not automatically a body citation · recosignal.com
- https://sofindable.com/methodologyretrieval source, not automatically a body citation · sofindable.com
- https://getaisnapshot.com/methodologyretrieval source, not automatically a body citation · getaisnapshot.com
- https://getfoundonai.com/assets/attachments/AIVO_Methodology.pdfretrieval source, not automatically a body citation · getfoundonai.com
- https://cdn.openai.com/pdf/a-family-guide-to-help-teens-use-ai-responsibly.pdfretrieval source, not automatically a body citation · cdn.openai.com
- https://ittc.ku.edu/~fli/papers/2024_ccs-checkgpt-full.pdfretrieval source, not automatically a body citation · ittc.ku.edu
- https://futureoflife.org/wp-content/uploads/2025/12/AI-Safety-Index-Report_131225_Full_Report_Digital.pdfretrieval source, not automatically a body citation · futureoflife.org
- https://hai.stanford.edu/assets/files/hai_ai_index_report_2025.pdfretrieval source, not automatically a body citation · hai.stanford.edu
- https://www.aigl.blog/content/files/2025/07/AI-Safety-Index-Summer-2025.pdfretrieval source, not automatically a body citation · www.aigl.blog
- https://www.reddit.com/r/SEO_LLM/comments/1vho94t/reviewcomparison_sites_pitching_a_new_ai/retrieval source, not automatically a body citation · www.reddit.com
- https://www.reddit.com/r/GEO_optimization/comments/1xd9m3v/what_i_learned_trying_to_measure_ai_visibility/retrieval source, not automatically a body citation · www.reddit.com
- https://www.reddit.com/r/SaaS/comments/1wro769/how_we_measure_ai_search_visibility_the_method/retrieval source, not automatically a body citation · www.reddit.com
- https://www.reddit.com/r/SEO/comments/1wrvs14/how_do_you_verify_an_ai_visibility_tracker_is/retrieval source, not automatically a body citation · www.reddit.com
- https://www.reddit.com/r/digital_marketing/comments/1ule9bi/sat_through_6_ai_search_optimization_pitches_this/retrieval source, not automatically a body citation · www.reddit.com
- https://www.reddit.com/r/SaaS/comments/1u2al4v/i_built_an_ai_visibility_tracker_ran_it_on_my_own/retrieval source, not automatically a body citation · www.reddit.com
- https://www.reddit.com/r/GEO_optimization/comments/1xbgclz/i_have_a_problem_with_ai_visibility_reports_that/retrieval source, not automatically a body citation · www.reddit.com
- https://www.reddit.com/r/SEMrush/comments/1rdk0hi/how_to_conduct_an_ai_visibility_audit_in_2026/retrieval source, not automatically a body citation · www.reddit.com
- https://www.reddit.com/r/aeo/comments/1uuz0yd/new_research_is_the_data_from_your_ai_visibility/retrieval source, not automatically a body citation · www.reddit.com
- https://www.reddit.com/r/aeo/comments/1wn1399/how_can_i_find_the_ai_prompts_where_my_website_is/retrieval source, not automatically a body citation · www.reddit.com
- https://www.reddit.com/r/GEO_optimization/comments/1w4ecsw/ai_visibility_tracking_needs_a_model_changelog/retrieval source, not automatically a body citation · www.reddit.com
- https://www.reddit.com/r/GEO_optimization/comments/1xd99cf/how_do_you_measure_brand_visibility_in_ai_answers/retrieval source, not automatically a body citation · www.reddit.com
- https://arxiv.org/abs/2603.25220retrieval source, not automatically a body citation · arxiv.org
- https://arxiv.org/abs/1810.03993retrieval source, not automatically a body citation · arxiv.org
- https://arxiv.org/abs/2505.18059retrieval source, not automatically a body citation · arxiv.org
- https://help.openai.com/en/articles/9237897-searching-the-web-with-chatgptretrieval source, not automatically a body citation · help.openai.com
- https://help.openai.com/en/articles/8590148-memory-in-chatgptretrieval source, not automatically a body citation · help.openai.com
- https://help.openai.com/en/articles/9237897-chatgpt-searchretrieval source, not automatically a body citation · help.openai.com
- https://help.openai.com/en/articles/8142208-chatgpt-ios-and-android-app-faqretrieval source, not automatically a body citation · help.openai.com
- https://help.openai.com/en/articles/9237897-chatgpt-search//retrieval source, not automatically a body citation · help.openai.com
- https://help.openai.com/en/articles/8590148-memory-faq%2525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525252525253F.avifretrieval source, not automatically a body citation · help.openai.com
- https://help.openai.com/en/articles/10408842-google-app-data-controls-faqretrieval source, not automatically a body citation · help.openai.com
- https://help.openai.com/en/articles/10093903-chatgpt-search-for-enterprise-and-eduretrieval source, not automatically a body citation · help.openai.com
- https://help.openai.com/en/articles/8590148-memory-faqretrieval source, not automatically a body citation · help.openai.com
- https://help.openai.com/en/articles/7039943-how-openai-handles-data-in-consumer-servicesretrieval source, not automatically a body citation · help.openai.com
- https://docs.x.ai/developers/tools/collections-searchretrieval source, not automatically a body citation · docs.x.ai
- https://docs.x.ai/developers/modelsretrieval source, not automatically a body citation · docs.x.ai
Evidence and qualifications
This is the existing redacted public record. It has not been rewritten for this page. Earlier privacy edits and collection qualifications continue to apply. Editorial text is English; a few original captures retain non-English UI badges or source-panel date labels. An answer’s empirical claims are platform output, not verified findings of this archive.
Body review
{
"reviewed_at": "2026-11-02T09:20:55.760328+00:00",
"reviewer": "assistant",
"complete_body_read": true,
"coherent_ending": true,
"annotation_and_explicit_url_coverage_checked": true,
"external_claims_verified": false,
"independent_human_double_coding": false
}
Existing public-text privacy policy
{
"body_changed": false,
"policy": "Only actual URL tracking, signed/session URL parameters and necessary identifying information are removed; original wording, including analytics parameter examples outside URLs, remains.",
"annotation_positions": "Original position indexes omitted because URL/privacy edits can change character locations."
}
Prompt SHA-256: e927e70f9860279797a292b031efab8dca60a13a2936d0a237c5c2c015170469
Answer SHA-256: a6ce8eb6ddf77c8a96218d616780f52337d8980aeaa517120b7821c056d076a9