kutesir/provoc-website
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update robots.txt #3

New Issue
Closed
opened 2026-07-02 22:22:28 +00:00 by kutesir · 0 comments
kutesir commented 2026-07-02 22:22:28 +00:00
Owner
Copy Link

Summary

Updated /public_html/robots.txt to reflect correct canonical domain and reduce crawl budget waste.

Changes made

  • Updated Sitemap URL: provoc.ug → https://provocgroup.com/sitemap.xml
  • Added Disallow: /js/ — prevents crawlers wasting budget on non-indexable JS assets
  • Added Disallow: /css/ — same for CSS assets

Final file

User-agent: *
Allow: /
Disallow: /js/
Disallow: /css/

Sitemap: https://provocgroup.com/sitemap.xml

Status

✅ Completed & deployed

## Summary Updated `/public_html/robots.txt` to reflect correct canonical domain and reduce crawl budget waste. ## Changes made - Updated Sitemap URL: `provoc.ug` → `https://provocgroup.com/sitemap.xml` - Added `Disallow: /js/` — prevents crawlers wasting budget on non-indexable JS assets - Added `Disallow: /css/` — same for CSS assets ## Final file ``` User-agent: * Allow: / Disallow: /js/ Disallow: /css/ Sitemap: https://provocgroup.com/sitemap.xml ``` ## Status ✅ Completed & deployed
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
kutesir
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: kutesir/provoc-website#3
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?