I am a Kagi user and have been for 7 months now. I signed up for the 300 searches per month plan because I felt like that would fit me well enough and it turns out I average 87 searches per month. That’s a lot lower than I thought it would be by quite a bit.
reddit recently updated their robots.txt to disallow all crawlers Google paid a bunch of money to have access to crawl reddit
You’ll still see old stuff, but crawlers that care about robots.txt will get no new information.
The best part of that robots.txt is:
Sure Jan.
Reddit believes in
an openpay to access internet, but not themisuse ofpublic contentour content we didn’t make.https://search.brave.com/search?q=site%3Areddit.com+trump&source=web&tf=pd Past day is not that old
A few possibilities,
No matter the reason, well behaving crawlers will no longer crawl reddit, Everything is disallowed in the robots.txt