About NicheNestBot
NicheNestBot collects public information about apps and websites (names, categories, prices, public ratings and popularity lists) to help developers find and validate ideas. It identifies itself with this user agent:
NicheNestBot/0.1 (+https://nichenest.app/bot)
How it behaves
- Obeys robots.txt, including Crawl-delay. If robots.txt is unreachable, it doesn't crawl.
- Makes one request at a time per site, with several seconds between requests.
- Uses conditional requests and caching to avoid re-downloading unchanged pages.
- Backs off on errors and stops automatically if a site keeps failing.
- Prefers official APIs and open datasets wherever they exist.
- Doesn't collect personal data; review text is only used in aggregate and shown paraphrased.
Opt out
Add User-agent: NicheNestBot / Disallow: / to your robots.txt, or email nichenest.app@gmail.com and we'll stop within one business day.