← All articles

Topic

generic scrape

  1. Convert any web page to Markdown for an LLM with one request (format=markdown)

    Add format=markdown to /v1/scrape: headings, lists, tables, code and absolute links come back, scripts and forms do not. Made for prompts and RAG chunks.

    · 2 min read

  2. CSS selectors in, JSON out: the extract parameter explained with examples

    Name fields as CSS selectors and /v1/scrape returns them as JSON: attributes, lists, inner HTML, absolute links, up to 50 fields, no parsing code.

    · 2 min read

  3. Read Open Graph, Twitter card and JSON-LD metadata from any URL with one request

    /v1/metadata returns title, description, canonical, favicon, language, Open Graph and Twitter tags and every JSON-LD block from the head alone. One credit.

    · 2 min read