Cleaning chatbot artefacts out of published copy

Updated 2026-09-20 · a working page, not a sales page

Sooner or later a live page says 'As an AI, I cannot provide legal advice' in the middle of a pricing section. It happens because someone copied the model's reply instead of just the content, and nobody read the whole paragraph before publishing.

Short answer

Search published pages for 'As an AI', 'I cannot', 'I'm sorry' and 'language model'.
Model refusals usually sit at the start of a section, where they look like an intro.
Copied replies also carry artefacts: bullet markers inside sentences, and stray 'Sure!' openings.
Check the last paragraph separately. Truncation leaves half-sentences there.
Keep a pre-publish grep in your release process, not in your memory.

How it gets in

Three routes. Someone asks a model for copy and pastes the whole reply including the preamble. Someone uses a scaffold that inserts a system note into the output. Or a generated FAQ answer includes a refusal because the question was borderline, such as asking for legal or medical advice.

The first route is the most common and the cheapest to prevent: copy the artifact you want, never the whole reply.

The checks that catch it

Before any deploy, run a text search over the changed files and the live pages for: 'As an AI', 'language model', 'I cannot', 'I apologize', 'Sure!', 'Here is the', 'Let me know if'. Most will be harmless. The one that is not is the one a customer screenshots.

For structured pages, also check that no list marker appears inside a sentence and that no section ends mid-clause — both are signs of a truncated paste.

Refusals that belong, phrased as policy

Some limits should be on the page. The difference is voice: 'we do not provide legal advice' is policy; 'As an AI language model, I cannot provide legal advice' is a chatbot transcript. Same meaning, and only one of them belongs on a business page.

Before / after

What people usually write	What it looks like after
As an AI language model, I cannot provide specific legal advice regarding your refund rights.	We do not give legal advice. If a refund is due under the terms, we process it within five working days.
Sure! Here is a table showing the pricing options for your consideration.	Pricing is US$15 a month, or US$19 for a one-off pack. Both are on the pricing page.
I apologize, but I am unable to verify whether this applies to your jurisdiction.	Our terms apply to all customers. For jurisdiction-specific questions, ask a local adviser.

What this page will not do. A search cannot catch a refusal that is paraphrased, and it will not catch factual errors. This pass is a last look, not a substitute for someone reading the page before it ships.

If you want this done to your own draft: ShipCopy takes a piece of text you already wrote and rewrites it in one of three modes — rewrite it to read human, turn a product description into launch copy, or turn a plain-language request into a reusable prompt. Six output formats, 13 languages. 10 generations free, no card.

See what it does Pricing — US$15/month

Questions

Should I disclose that AI helped write the page?

Disclose what your platform or jurisdiction requires. Refusal artefacts and disclosure are separate issues — one is a bug, the other is a policy.

How do I stop this happening again?

Put the search in the deploy script so it runs whether or not anyone remembers.

Does this affect search ranking?

It is not a ranking factor. It is a credibility problem that a visitor will notice.