# Comprehensive Robots.txt for Search Engines (Google, Bing, Yahoo, DuckDuckGo)
# User: Vishal Kumar AI Academy

User-agent: *
Allow: /
Disallow: /scratch/
Disallow: /.gemini/
Disallow: /.git/

# Optimized Crawl Rate for Major Search Engines
User-agent: Googlebot
Allow: /

User-agent: Bingbot
Allow: /

User-agent: Slurp
Allow: /

User-agent: DuckDuckBot
Allow: /

# Canonical XML Sitemap
Sitemap: https://www.vishalkumar.site/sitemap.xml