I am a Kagi user and have been for 7 months now. I signed up for the 300 searches per month plan because I felt like that would fit me well enough and it turns out I average 87 searches per month. That’s a lot lower than I thought it would be by quite a bit.
reddit recently updated their robots.txt to disallow all crawlers Google paid a bunch of money to have access to crawl reddit
You’ll still see old stuff, but crawlers that care about robots.txt will get no new information.
https://search.brave.com/search?q=site%3Areddit.com+trump&source=web&tf=pd Past day is not that old
A few possibilities,
No matter the reason, well behaving crawlers will no longer crawl reddit, Everything is disallowed in the robots.txt
The best part of that robots.txt is:
Sure Jan.
Reddit believes in
an openpay to access internet, but not themisuse ofpublic contentour content we didn’t make.