To prevent unwanted information inside the search indexes, website owners can instruct spiders to not crawl specific files or directories from the common robots.txt file in the root Listing on the domain. On top of that, a site could be explicitly excluded from the internet search engine's databases through the https://eatatstreet.com