twitter-reader

Twitter Reader fetches Twitter/X post and article content together with author information, engagement metrics, and embedded media. It is aimed at cases where tweet or long-form X Article content needs to be retrieved and saved, and it is positioned as preferable to Jina for X Articles that contain images because it downloads all images locally and produces complete Markdown with proper image references.

The recommended path is the fetch_article.py script, run via uv with the form uv run --with pyyaml python scripts/fetch_article.py followed by an article URL and an optional output directory. This full-article mode fetches structured data through twitter-cli (likes, retweets, bookmarks), retrieves content and images through the jina.ai API, downloads every image into an attachments folder named by date, author, and title, and writes a Markdown file with YAML frontmatter suited to PKM systems. A simpler text-only mode uses the Jina API directly, via curl to r.jina.ai or the fetch_tweet.py and fetch_tweets.sh scripts, and returns title, source URL, published time, and Markdown with remote media URLs, requiring only a JINA_API_KEY.

Prerequisites differ by mode: full-article mode needs uv and auto-installs twitter-cli with no further setup, while the Jina simple mode needs the JINA_API_KEY environment variable set from a jina.ai account. Supported URL formats include x.com/USER/status/ID for posts, x.com/USER/article/ID for long-form articles, and legacy twitter.com/USER/status/ID links. The output structure places the main Markdown file in the chosen output directory alongside a dedicated attachments folder of numbered images, making the result self-contained for note archives and clipping workflows.