![websites-can-now-block-openai’s-web-crawling-bot-[techspot]](https://i0.wp.com/upmytech.com/wp-content/uploads/2023/08/136950-websites-can-now-block-openais-web-crawling-bot-techspot.jpg?resize=800%2C445&ssl=1)
Websites can now block OpenAI’s web crawling bot [TechSpot]
View Article on TechSpot
ChatGPT’s LLM has been developed by scraping vast amounts of freely available internet content, a fact that OpenAI readily acknowledges. The company is now providing instructions on how webmasters, server administrators, and internet companies can prevent its crawling technology from accessing their websites.