It Is possible to include these pages on the file to get explicitly disregarded. Robots.txt files use a thing called the Robots Exclusion Protocol. This website will simply deliver the file for you personally with inputs of pages to become excluded. Generator sitemap for builders can help develop a sitemap https://seotoolstube.com/