Post by mimjannat on Jan 14, 2024 3:13:31 GMT
When you check the checkbox, WordPress makes some edits in the robots.txt file and adds a line to your website header that discourages search engines from indexing your website. Most search engines respect your request and skip indexing your website. However, some search engines can also ignore your request and may continue to index some of your pages or even image files. Method Prevent Search engines from indexing WordPress site by editing robots.txt file using cPanel of your WordPress hosting.
If you want to do it manually, there is a way to stop search engines from crawling your site manually. You can use File Manager or an FTP client to edit the robots.txt file. This method instructs all search engines to skip C Level Email List crawling and prevent them from indexing your site. All you need to do is add a simple syntax to the robots txt file to your website’s root directory. Step Login to the cPanel of your web hosting and navigate to your File Manager.
Step Navigate to your WordPress root directory folder, which is often publichtml, and find the robots.txt file under it. In case you can’t find it, create a new blank file. Step Right-click on the file and select Edit. Step Enter the following syntax- User-agent Disallow This syntax will prevent search engines from indexing your whole site. In case you want to block indexing of a specific page or post, write the page’s subdirectory and slug. For instance Disallow blog prestashop-review. Moreover, be careful when editing as the syntaxes in robots.txt files are case sensitive.
If you want to do it manually, there is a way to stop search engines from crawling your site manually. You can use File Manager or an FTP client to edit the robots.txt file. This method instructs all search engines to skip C Level Email List crawling and prevent them from indexing your site. All you need to do is add a simple syntax to the robots txt file to your website’s root directory. Step Login to the cPanel of your web hosting and navigate to your File Manager.
Step Navigate to your WordPress root directory folder, which is often publichtml, and find the robots.txt file under it. In case you can’t find it, create a new blank file. Step Right-click on the file and select Edit. Step Enter the following syntax- User-agent Disallow This syntax will prevent search engines from indexing your whole site. In case you want to block indexing of a specific page or post, write the page’s subdirectory and slug. For instance Disallow blog prestashop-review. Moreover, be careful when editing as the syntaxes in robots.txt files are case sensitive.