They uncover Web sites by “crawling” from URL to URL, and as they shift through pages, the bots scrutinize the leading textual content and supplementary parts of the web page. Search engines are relatively secretive in regards to the methods they use and frequently alter them to boost search results. https://thestargateproject.io