Many website owners are faced with the problem of prohibiting the indexing of resources and their removal from search engines. This usually happens because the site becomes outdated and irrelevant, the publisher or visitors lose interest in the site, or the site contains personal and even confidential information.
Instructions
Step 1
There are many ways to remove a site from search engines.
The first and easiest way to delete query results from the search engine is to delete the page from the site itself or to completely delete the CMS site via an FTP connection. In a few days, the search engine will update the database and remove the link to your resource from the search results.
Step 2
The most popular way among webmasters to protect a site, its individual sections or pages from indexing, and thereby remove links from search results, is to edit the robots.txt file.
You can close a separate page from indexing using the code:
User-Agent: *
Disallow: /page.html (closing the page page.html)
There are many author's instructions on how to use codes for a robots.txt file on the Internet.
Step 3
The third way to remove pages from a site from search engines is to use the robots meta tag in its pages. The tag is written in the HTML code of the hidden pages between the tags.
Thus, after reindexing the PS site, pages with this meta tag will drop out of search. The disadvantage of this method is that many modern sites use tpl templates, which means that you will have to manually change the code in hundreds, maybe thousands of pages.
Step 4
The fourth way to remove sites from search engines is by using X-Robots-Tag headers. The essence of this header is similar to the use of the previous meta tag, however, the entry must be located in the http headers:
X-Robots-Tag: noindex, nofollow
Step 5
The most effective way to remove a website (entirely) from search engines is to remove it from the webmaster's panel. After the update (3-7 days), the site will be inaccessible to the search engine. The webmaster's panel is available for search engines Yandex (https://webmaster.yandex.ru/delurl.xml) and Google (https://webmaster.yandex.ru/delurl.xml).
