Issue: Without a robots.txt file, search engines may crawl unnecessary or sensitive content, wasting crawl budget and potentially exposing private information. Fix: Create a robots.txt file to guide search engines on what to crawl and what…