Back

Firecrawl Knowledge Ingest

Writing & docs4.3K installs

What it does

Use this when a docs portal needs browser navigation, auth, pagination, or JS rendering.

Install

npx skills add https://github.com/firecrawl/skills --skill firecrawl-knowledge-ingest

Website

www.skills.sh/firecrawl/skills/firecrawl-knowledge-ingest

Details

From the skill’s SKILL.md or README, by its authors. View the original

Firecrawl Knowledge Ingest

Use this when a docs portal needs browser navigation, auth, pagination, or JS rendering.

Onboarding Interview

Infer the portal URL, output format, auth needs, and page limit from context. If the portal is clear, proceed immediately.

Ask at most 1-3 concise questions only if blocked, such as the portal URL, whether authentication is required, or the desired output format.

Firecrawl Collection Plan

Use Firecrawl browser to:

  • open the portal and inspect navigation
  • identify sections, categories, sidebar links, and article URLs
  • follow sidebar navigation, next links, pagination, load-more controls, or search
  • scrape article content as markdown
  • extract metadata such as title, section, last updated date, author, and tags

Try Firecrawl map as a supplement for public URLs, but use browser navigation for auth-gated or JS-heavy content.

Final Deliverable

# Knowledge Ingest: [Portal]

## Summary
[Pages extracted, sections covered, limitations]

## Output
[JSON/markdown/merged file path or content]

## Sections
[Section names and article counts]

## Failed Or Restricted Pages
[Any access/loading issues]

## Sources
[URLs extracted]

## Rerun Inputs
workflow: firecrawl-knowledge-ingest
url: [portal url]
format: [json/markdown/merged]
max_pages: [number]

JSON Shape

Use source, url, extractedAt, totalArticles, and sections[] with article title, url, section, content, and metadata.

Quality Bar

  • Preserve code examples, tables, and formatting.
  • Strip nav chrome, headers, and footers.
  • Track extraction progress and page failures.
  • Respect authentication boundaries.

More Writing & docs skills

See all

  • Writing & docs

    Grill With Docs

    A relentless interview to sharpen a plan or design, which also creates docs (ADR's and glossary) as we go.

    npx skills add https://github.com/mattpocock/skills --skill grill-with-docs
    1.3M installs

  • Writing & docs

    Triage

    Move issues and external PRs through a state machine of triage roles, categorise, verify, grill if needed, and write agent-ready briefs.

    npx skills add https://github.com/mattpocock/skills --skill triage
    1.1M installs

  • Writing & docs

    Domain Modeling

    Build and sharpen a project's domain model. Use when discussing codebase terminology, writing or editing a GLOSSARY.md, or recording or editing an ADR.

    npx skills add https://github.com/mattpocock/skills --skill domain-modeling
    952.2K installs

  • Writing & docs

    Writing Beats

    Writing, exploit; assemble raw material into a journey of beats, grounding each term before a beat leans on it.

    npx skills add https://github.com/mattpocock/skills --skill writing-beats
    528.6K installs

Skills are shared by members and not reviewed by us. Read a skill’s code before you install it.