
What Is Duplicate Content?
Duplicate content is the same or very similar content appearing at more than one URL, on one site or across several. It rarely brings a penalty. Its real costs are split ranking signals, the wrong URL appearing in results and wasted crawling. The fixes are redirects, canonical tags, consistent internal links and, for near-duplicates, consolidating or differentiating the pages.
| Myth | Reality |
|---|---|
| Google penalises duplicate content | No general penalty; it picks one version to show |
| Any repeated text is a problem | Boilerplate, quotes and standard descriptions are normal |
| You must block duplicates in robots.txt | Blocking stops Google reading your canonical |
| Translated pages are duplicates | Different languages are not duplicates |
| Republishing your article elsewhere always hurts | Manageable with a canonical or a link to the original |
| A duplicate checker score must be 0% | No such requirement exists |
Google’s SEO Starter Guide puts it plainly: if you have content accessible under multiple URLs, it is fine; do not fret about it. It adds that handling duplicates well is still worthwhile.
Is There a Duplicate Content Penalty?
No, not for ordinary duplication. When Google finds the same content at several URLs, it chooses one as the canonical to index and show. The others are treated as duplicates and crawled less often.
The exception is deliberate deception. Google’s spam policies cover scraping, where content is taken from other sites without adding value, and scaled content abuse, where many pages are generated mainly to manipulate rankings. Those are spam, and can lead to demotion or a manual action.
So the question is not “will I be penalised?” but “is Google showing the version I want, and are my signals combined?”
What Does Duplicate Content Actually Cost?
| Cost | What happens |
|---|---|
| Split signals | Links to different versions are not always combined |
| Wrong URL shown | A parameter or print version appears in results |
| Crawl waste | Search engines spend time on copies; matters for large sites |
| Self-competition | Two of your pages alternate for one query |
| Diluted reporting | Clicks and impressions spread across URLs |
| Lost credit | A larger site republishing your article may outrank you |
For a small site with a few duplicates, the cost is slight. For a store with thousands of filter URLs, it can be serious.
What Causes Duplicate Content?
Most duplication is technical and accidental. Google’s guide to consolidating duplicate URLs lists typical causes.
On your own site
- URL parameters: tracking, sorting, filtering, session IDs.
- Protocol and host variants: HTTP, HTTPS, www, non-www.
- Trailing slashes and letter case.
- A product in several categories, each with its own path.
- Printer and mobile versions.
- Pagination, and archive pages by tag, date and author.
- Staging or development sites left open.
- Near-identical pages: location pages with only the town changed; product variants.
Across sites
- Manufacturer descriptions used by every retailer.
- Syndicated articles and press releases.
- Scrapers copying your content.
- Your own multiple domains showing the same site.
How Do You Find Duplicates?
- Search Console, Page indexing report. Look at “Duplicate without user-selected canonical”, “Duplicate, Google chose different canonical than user” and “Alternate page with proper canonical tag”.
- Crawl the site. A crawler reports duplicate titles, descriptions, headings and near-duplicate content. See our guide to using an SEO crawler.
- Check host variants by hand. Type the HTTP, HTTPS, www and non-www versions; all should redirect to one.
- Search a distinctive sentence in quotes to find copies on other sites.
- Review the Performance report for queries where two of your URLs appear.
- Use the URL Inspection tool to see the Google-selected canonical for key pages.
Want this handled for you?
Our SEO services start with a full audit and a written plan, followed by a monthly report that shows what changed and why.
See our SEO servicesHow Do You Fix Technical Duplicates?
Choose the method by whether the duplicate URL needs to exist.
| Situation | Fix |
|---|---|
| The duplicate is not needed | 301 redirect to the main URL |
| The duplicate must stay reachable | rel=”canonical” to the main URL |
| Host and protocol variants | 301 redirect to one version |
| Tracking parameters | Self-referencing canonical on the clean URL |
| Filter and sort URLs | Canonical to the category, or disallow crawling |
| Non-HTML duplicates, such as PDFs | Canonical HTTP header |
| Staging site | Password-protect it |
Then make every signal agree:
- Internal links point to the canonical URL.
- The sitemap lists canonical URLs only.
- Hreflang references canonical URLs.
Google says redirects and rel=”canonical” are strong signals, and sitemap inclusion is a weak one. See our guides to canonical tags and 301 redirects.
Do not block duplicates with robots.txt as a fix. Google cannot read a canonical on a page it is not allowed to crawl, and the URL can still be indexed without content.
How Do You Fix Near-Duplicates?
Near-duplicates are separate pages with mostly the same content. A canonical tag is not the right tool when both pages are meant to rank.
| Type | Fix |
|---|---|
| Location pages with swapped town names | Add real local content, or merge into fewer pages |
| Product variants with identical text | One page with selectors, or unique content per variant |
| Several articles on one topic | Merge into one stronger article; redirect the others |
| Category and tag pages listing the same posts | Noindex thin tags; keep categories |
| Manufacturer descriptions | Rewrite for your best sellers; add reviews and your own detail |
| Thin pages differing by one parameter | Remove or consolidate |
The principle: each indexable page should offer something a searcher cannot get from your other pages.
Pages mass-produced with only a place name changed risk more than duplication. Google’s spam policies describe doorway abuse as pages created to rank for specific, similar queries.
How Much Duplicate Content Is Acceptable?
No percentage is defined. Repeated elements are normal:
- Headers, footers, navigation and sidebars.
- Legal notices and shipping information on every product.
- Quotations, with attribution.
- Product specifications shared across a range.
What matters is whether the main content of each page is distinct and useful. A product page with standard delivery text and a unique description is fine. A hundred pages whose only difference is one word are not.
Tools that report “duplicate content percentage” are giving their own estimate. Use it to find pages to review, not as a target.
Does Translated Content Count as Duplicate?
No. The same content in different languages is not duplicate content. Each language version serves a different audience.
- Use hreflang to connect the versions.
- Give each version a self-referencing canonical.
- Translate fully, including navigation and metadata.
Same-language regional versions, such as English for the UK and the US, are more similar. Hreflang tells search engines which to show where. Add real differences where they exist: spelling, currency, prices, delivery. See our guide to hreflang tags.
Raw machine translation published at scale without review is a quality issue, not a duplication one.
What About Content Copied to Other Sites?
When you syndicate deliberately
Ask the republisher to add a canonical tag pointing to your original, or at least a clear link back to it. Google has advised that a noindex on the republished copy is the surest way to keep it out of results.
When someone copies you
Google’s systems aim to identify the original. Usually no action is needed. If a copy outranks you or misuses your content, you can file a copyright removal request with the search engine and the host.
When you use others’ content
Manufacturer text, stock descriptions and feeds give you the same page as everyone else. Add your own description, photos, reviews and advice.
How Do You Prevent Duplication?
- Choose one URL format, and enforce it with redirects.
- Add self-referencing canonicals to every template.
- Link internally to clean URLs.
- Plan filters and parameters before building.
- Map each topic to one page, so writers do not create overlaps.
- Protect staging sites.
- Audit twice a year.
For controlling duplicate URLs at scale, see our guide to ecommerce SEO strategy. For deciding which pages to merge, see our guide to a content audit.
Frequently Asked Questions
Is there a duplicate content penalty?
No general one. Google normally picks one version of duplicated content to index and ignores the rest. Action is taken only against deceptive practices, such as scraping other sites or mass-generating pages to manipulate rankings. The usual cost of duplicates is split signals and wasted crawling.
How much duplicate content is acceptable?
There is no set percentage. Shared elements such as menus, footers, legal text and standard specifications are normal. What matters is that each page’s main content is distinct and useful. Treat percentage figures from checking tools as a prompt to review, not as a limit.
Does translated content count as duplicate?
No. The same content in different languages serves different audiences and is not treated as duplicate. Connect the versions with hreflang, and give each a self-referencing canonical. For regional versions in the same language, hreflang helps search engines show the right one.
Should I block duplicate pages in robots.txt?
No. If Google cannot crawl a duplicate, it cannot see the canonical tag or redirect that tells it which version to prefer, and the blocked URL can still be indexed without its content. Use redirects or canonical tags, and keep the pages crawlable.
What should I do if another site copies my content?
Usually nothing, since search engines generally identify the original. If the copy outranks you or the misuse is serious, file a copyright removal request with the search engine and contact the site’s host. For authorised republishing, ask for a canonical tag or link to your original.
Related Guides
Want this done for you?
See what each monthly plan includes, or send us your site and questions on WhatsApp. We do not promise rankings; we show the work and the data every month.
View SEO packages Chat on WhatsAppSources



