ScrapeGraphAI
Python scraper library that uses LLMs and direct graph logic to extract website data.
Why consider ScrapeGraphAI?
ScrapeGraphAI is an open-source web scraping Python library that uses LLMs (OpenAI, Ollama, Groq) and Direct Acyclic Graph (DAG) pipelines to automatically extract structured JSON data from any website without manual CSS selectors.
Learn ScrapeGraphAI by building
Practical setup notes, real use cases, and copy-ready examples in one focused guide.
In this guide2 sections
Overview of ScrapeGraphAI
ScrapeGraphAI adapts automatically to website layout changes, generating robust extraction pipelines purely from natural language prompts.
Quickstart
pip install scrapegraphaifrom scrapegraphai.graphs import SmartScraperGraphgraph_config = { "llm": {"model": "ollama/llama3", "temperature": 0}, "headless": True}smart_scraper_graph = SmartScraperGraph( prompt="List all company news titles and dates", source="https://example.com/news", config=graph_config)result = smart_scraper_graph.run()print(result)ScrapeGraphAI is licensed under the Apache License Version 2.0.
Related tools
More options with a similar category or technology profile.
marimo
A reactive Python notebook that is reproducible, git-friendly, and executable as a script.
JupyterLab
The next-generation web-based user interface for Project Jupyter computational notebooks.
Trafilatura
Python package and command-line tool designed to gather text and metadata on the Web.
OpenedAI Speech
OpenAI-compatible text-to-speech server that translates text into spoken audio using open models.