a4abcf8e05
Backend: - Add Swagger annotations to all job handlers (GET, POST, PUT, DELETE) - Clean up job handler code Frontend: - Expand api.ts with ApiJob types, pagination, and transform function - Update footer with 'Vagas por Tecnologia' SEO links - Add robots.txt with crawler directives - Add sitemap.xml with main pages and job URLs - Change branding to GoHorse Jobs
15 lines
292 B
Text
15 lines
292 B
Text
# https://www.robotstxt.org/robotstxt.html
|
|
User-agent: *
|
|
Allow: /
|
|
|
|
# Sitemap
|
|
Sitemap: https://gohorsejobs.com/sitemap.xml
|
|
|
|
# Crawl-delay for polite bots
|
|
Crawl-delay: 1
|
|
|
|
# Disallow admin/dashboard areas from indexing
|
|
Disallow: /dashboard/
|
|
Disallow: /api/
|
|
Disallow: /login
|
|
Disallow: /cadastro/
|