Reddit Cuts off Search Engine Scrapers, Including Bing
This is interesting. This week, Reddit mas moved to block search engines not named Google from crawling its site, via an update to its robot.txt file which blocks their crawlers. Microsoft’s Bing has now stopped crawling Reddit, after an update...
Recent Comments