Web scraping, indexing, and scanning applications (resource overusage)

You cannot host websites or applications that that scan, scrape, or index external sites. Doing so can cause you to overuse your hosting resources.

Is this an issue for me?

Here are some common sources of excessive resource usage due to web scraping or indexing:

  • Hosting applications intended to generate content by web scraping or web indexing
  • Hosting applications that automatically generate content strictly for SEO purposes
  • Hosting applications that duplicate external site content

How can I correct this issue?

You can try to correct resource usage caused by web scraping by following any and all of these steps:

  • Remove any and all applications intended to generate web scraping content.
  • Remove any automated content generation for strictly SEO purposes.
  • Migrate to a VPS or dedicated server if the above steps are not an option.

Next steps

If you are still experiencing issues with resource usage, review your hosting for other possible causes at Common causes for resource overusage (Linux).

Note: You will want to make sure that you are correcting the underlying cause to any resource issue. Simply removing sites and/or files without correcting the underlying issue can cause the problem to recur.


Var den här artikeln till hjälp?
Tack för din feedback. Ring vårt supportnummer eller starta chattalternativet ovan om du vill prata med en medarbetare på kundtjänst.
Vi är glada att vi kunde hjälpa till! Finns det något mer vi kan göra för dig?
Det var tråkigt att höra. Berätta vad som var krångligt eller varför lösningen inte hjälpte dig med problemet.