Back to Skills

baoyu-url-to-markdown

Fetch any URL and convert to markdown using baoyu-fetch CLI (Chrome CDP with site-specific adapters). Built-in adapters for X/Twitter, YouTube transcripts, Hacker News threads, and generic pages via Defuddle. Handles login/CAPTCHA via interaction wait modes. Use when user wants to save a webpage as markdown.

14,162stars1,632forksUpdated 4/12/2026

Security Assessment

Safe(100/100)
Security Score100/100

About baoyu-url-to-markdown

The baoyu-url-to-markdown skill is designed to fetch any webpage and convert its content into clean, structured markdown format. It leverages the baoyu-fetch CLI, which uses Chrome DevTools Protocol (CDP) along with site-specific adapters to accurately extract content from various types of web pages. This skill addresses the common challenge of saving online content in a readable, offline-friendly format while preserving the structure and important elements of the original page. By automating the conversion process, it eliminates manual copy-pasting and formatting, which can be time-consuming and error-prone, especially for content-heavy pages.

FAQ

How do I run the baoyu-url-to-markdown skill?

You execute the skill via the baoyu-fetch CLI. Determine the skill's base directory and run the CLI script located at scripts/vendor/baoyu-fetch/src/cli.ts using either bun or npx, depending on which is installed on your system.

Which types of webpages are supported?

The skill includes built-in adapters for X/Twitter, YouTube transcripts, Hacker News threads, and generic pages through Defuddle. It can handle login and CAPTCHA challenges via interaction wait modes.

What should I do if EXTEND.md is missing?

If EXTEND.md is not found, you must perform the first-time setup by answering a set of questions about media handling, output directory, and where to save preferences. The skill will not proceed with conversion until this setup is complete.

Can I configure where downloaded media is saved?

Yes. During first-time setup or by editing EXTEND.md, you can choose whether to always download media, ask each time, or never download. Media is saved in local imgs/ and videos/ directories if downloaded.

What are the system requirements for running this skill?

You need either bun or npx installed to run the CLI. The skill is compatible with macOS, Linux, WSL, Git Bash, and PowerShell environments for Windows.

All Files

48 files
SKILL.md14.8 KB
View
scripts/package.json0.2 KB
View
scripts/vendor/baoyu-fetch/package.json1.6 KB
View
scripts/vendor/baoyu-fetch/src/adapters/index.ts0.8 KB
View
scripts/vendor/baoyu-fetch/src/adapters/x/index.ts4.0 KB
View
scripts/vendor/baoyu-fetch/src/adapters/x/payloads.ts1.6 KB
View
scripts/vendor/baoyu-fetch/src/adapters/x/single.ts2.5 KB
View
scripts/vendor/baoyu-fetch/src/adapters/x/thread-loader.ts8.8 KB
View
scripts/vendor/baoyu-fetch/src/adapters/x/types.ts0.6 KB
View
scripts/vendor/baoyu-fetch/src/adapters/youtube/utils.ts6.4 KB
View
scripts/vendor/baoyu-fetch/src/browser/cookie-sidecar.ts2.9 KB
View
scripts/vendor/baoyu-fetch/src/browser/page-snapshot.ts3.3 KB
View
scripts/vendor/baoyu-fetch/src/cli.ts6.9 KB
View
scripts/vendor/baoyu-fetch/src/extract/html-cleaner.ts10.8 KB
View
scripts/vendor/baoyu-fetch/src/extract/markdown-renderer.ts4.5 KB
View
scripts/vendor/baoyu-fetch/src/media/default-downloader.ts5.1 KB
View
scripts/vendor/baoyu-fetch/src/media/media-utils.ts6.1 KB
View
scripts/vendor/baoyu-fetch/src/types/defuddle-node.d.ts0.6 KB
View
scripts/vendor/baoyu-fetch/src/utils/url.ts0.3 KB
View
scripts/bun.lock55.6 KB
View
scripts/vendor/baoyu-fetch/README.zh-CN.md3.2 KB
View
scripts/vendor/baoyu-fetch/src/adapters/hn/index.ts10.2 KB
View
scripts/vendor/baoyu-fetch/src/adapters/x/article.ts11.8 KB
View
scripts/vendor/baoyu-fetch/src/adapters/x/match.ts0.3 KB
View
scripts/vendor/baoyu-fetch/src/adapters/x/shared.ts11.5 KB
View
scripts/vendor/baoyu-fetch/src/adapters/x/thread.ts9.0 KB
View
scripts/vendor/baoyu-fetch/src/adapters/youtube/transcript.ts13.0 KB
View
scripts/vendor/baoyu-fetch/src/browser/chrome-launcher.ts5.7 KB
View
scripts/vendor/baoyu-fetch/src/browser/network-journal.ts7.0 KB
View
scripts/vendor/baoyu-fetch/src/browser/session.ts4.5 KB
View
scripts/vendor/baoyu-fetch/src/extract/document.ts0.8 KB
View
scripts/vendor/baoyu-fetch/src/extract/html-to-markdown.ts20.8 KB
View
scripts/vendor/baoyu-fetch/src/media/types.ts0.7 KB
View
scripts/vendor/baoyu-fetch/src/utils/logger.ts0.6 KB
View
references/config/first-time-setup.md2.4 KB
View
scripts/vendor/baoyu-fetch/README.md4.4 KB
View
scripts/vendor/baoyu-fetch/src/adapters/generic/index.ts2.4 KB
View
scripts/vendor/baoyu-fetch/src/adapters/types.ts2.1 KB
View
scripts/vendor/baoyu-fetch/src/adapters/x/login.ts2.2 KB
View
scripts/vendor/baoyu-fetch/src/adapters/x/session.ts1.4 KB
View
scripts/vendor/baoyu-fetch/src/adapters/youtube/index.ts0.9 KB
View
scripts/vendor/baoyu-fetch/src/browser/cdp-client.ts6.7 KB
View
scripts/vendor/baoyu-fetch/src/browser/interaction-gates.ts4.0 KB
View
scripts/vendor/baoyu-fetch/src/browser/profile.ts5.5 KB
View
scripts/vendor/baoyu-fetch/src/commands/convert.ts17.0 KB
View
scripts/vendor/baoyu-fetch/src/extract/html-extractor.ts2.2 KB
View
scripts/vendor/baoyu-fetch/src/media/markdown-media.ts12.9 KB
View
scripts/vendor/baoyu-fetch/src/types/shims.d.ts0.4 KB
View

Install baoyu-url-to-markdown

Download and extract the skill files to your .claude/skills/ directory.

Quick Setup:

  1. Copy the skill folder to .claude/skills/
  2. Claude will automatically detect and use the skill