fix: add likes leaderboard and noodles to robots.txt

[MaxwellCohen]

🔗 Linked issue

Resolves: #3066

Partially resolves: #2924

🧭 Context

Robots.txt helps keep websites safe from crawlers. This pr updats it so we have better alignment with those goals.

Currently, the Awesome Noodles section is not available for search

📚 Description

This adds 2 changes to the robots.txt

1. Adds an allow for the leaderboard page so it can be indexed for search
2. Adds an allow for the awesome new noodles section so it can be indexed for search

Once this is released, it will result on the

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
npmx.dev	Ready	Preview, Comment	Jul 22, 2026 12:04pm

2 Skipped Deployments

Project	Deployment	Actions	Updated (UTC)
docs.npmx.dev	Ignored	Preview	Jul 22, 2026 12:04pm
npmx-lunaria	Ignored		Jul 22, 2026 12:04pm

[coderabbitai]

📝 Walkthrough

Walkthrough

public/robots.txt adds wildcard crawler permissions for /leaderboard/likes and /noodles.

Changes

Robots crawler directives

Layer / File(s)	Summary
Crawler allow-list public/robots.txt	Permits crawlers to access /leaderboard/likes and /noodles under User-agent: *.

Possibly related PRs

• npmx-dev/npmx.dev#2892: Restructures the bot allow/disallow rules in the same public/robots.txt policy area.

🚥 Pre-merge checks | ✅ 4

✅ Passed checks (4 passed)

Check name	Status	Explanation
Linked Issues check	✅ Passed	The change matches #3066 by adding Allow rules for /leaderboard/likes and /noodles.
Out of Scope Changes check	✅ Passed	No out-of-scope code changes are present; the PR only updates public/robots.txt with the requested rules.
Title check	✅ Passed	The title accurately summarises the robots.txt update to allow the likes leaderboard and noodles pages.
Description check	✅ Passed	The description is clearly related to the robots.txt change and explains the two added allow rules.

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ All tests successful. No failed tests found.

📢 Thoughts on this report? Let us know!

[ghostdevv]

ty!