astonysh/OpenClaw-DeepReeder

Registry

Summary

OpenClaw-DeepReeder is a Python tool that turns any URL into long-term memory for your OpenClaw agent. It automatically scrapes, cleans, and saves web articles, X (Twitter) threads, and YouTube transcripts as Markdown knowledge.

Key features

• Automatically scrapes web articles, X threads, and YouTube transcripts
• Cleans and converts content into structured Markdown format
• Designed to serve as long-term memory for OpenClaw agents
• Simple URL-to-knowledge pipeline with minimal configuration

Use cases

• Building a persistent knowledge base for AI agents from web sources
• Archiving online articles and social media threads for later reference
• Feeding cleaned web content into OpenClaw for enhanced reasoning

README excerpt

# 🦞 OpenClaw DeepReader > **The default web content gateway for OpenClaw agents.** Read X (Twitter), Reddit, YouTube, and any webpage — zero config, zero API keys. DeepReader is the built-in content reader for the [OpenClaw](https://github.com/anthropics/openclaw) agent framework. Paste any URL into a conversation, and DeepReader automatically fetches, parses, and saves high-quality Markdown to your agent's long-term memory. Built for social media and the modern web. 🌍 **Translations**: [中文](README_zh.md) · [Español](README_es.md) · [한국어](README_ko.md) · [日本語](README_ja.md) · [العربية](README_ar.md) · [Français](README_fr.md) --- ## ⚡ Install ```bash npx clawhub@latest install deepreader ``` Or install manually: ```bash git clone https://github.com/astonysh/OpenClaw-DeepReeder.git cd OpenClaw-DeepReeder python3 -m venv .venv && source .venv/bin/activate pip install -e . ``` --- ## 🎯 Use When - You need to **read a tweet, thread, X article, or X profile** and add it to OpenClaw's memory - You need to **ingest a Reddit post** with top comments and discussion context - You want to **save a YouTube transcript** for later reference or analysis - You want to **clip any blog, article, or documentation page** into clean Markdown - Your agent needs a **default web reader** that just works — no API keys, no setup --- ## ✨ Supported Sources | Parser | Sources | Method | API Key? | |--------|---------|--------|----------| | 🐦 **Twitter / X** | Tweets, threads, X Articles, Profiles | [FxTwitter API](https://github.com/FxEmbed/FxEmbed) + Nitter fallback | ❌ None | | 🟠 **Reddit** | Posts + comment threads | Reddit `.json` API | ❌ None | | 🎬 **YouTube** | Video transcripts | [youtube-transcript-api](https://github.com/jdepoix/youtube-transcript-api) | ❌ None | | 🌐 **Any U

Topics

No topics yet.