What it does
LLM Scraper is a TypeScript library that loads a web page and asks an AI language model to pull out the information you want in a set shape, such as a list of product names and prices.
You describe the shape of the data you want, and the library returns it in that shape. It can read the page as HTML, plain text, Markdown or a screenshot.
It works with models from OpenAI, Anthropic, Google and open models such as Llama and Qwen, and it can also write reusable scraping code for you.
Who it's for
Developers who need to collect data from websites.
Can I use it without coding?
Developers only. It is a programming library for JavaScript and TypeScript projects. New to this? Start here.
Can I run it?
- Cost
- Free, but needs an AI accountThe software is free, but it uses an online AI service (like OpenAI or Anthropic), which usually charges for use.
- Computer
- An ordinary computer is fine
- Privacy
- Your choice: run it on your device or use an online service
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (MIT): Very permissive: free to use, change and share, including for business.
- More on staying safe
Where people are talking about it
- Show HN: LLM Scraper – turn any webpage into structured dataHacker News · Apr 2024