DuckDB Webbed Extension

A comprehensive XML and HTML processing extension for DuckDB that enables SQL-native analysis of structured documents with intelligent schema inference and powerful XPath-based data extraction.

Getting Started

• Installation
  • Quick Install
  • Requirements
  • Verifying Installation
  • Building from Source
• Quick Start
  • Loading the Extension
  • Reading XML Files
  • Reading HTML Files
  • Extracting Data with XPath
  • Working with Document Objects
  • Converting Between Formats
  • Extracting Links and Images from HTML
  • Parsing XML/HTML Strings
  • Controlling Date/Time Parsing
  • Handling NULL Values
  • Processing Large Files
  • Extracting HTML Tables
  • Next Steps

Function Reference

• Function Reference
  • Function Categories
  • Quick Reference
• File Reading & String Parsing Functions
  • read_xml
  • read_xml_objects
  • read_html
  • read_html_objects
  • String Parsing Functions
• XML Extraction Functions
  • xml_extract_text
  • xml_extract_all_text
  • xml_extract_elements
  • xml_extract_elements_string
  • xml_extract_attributes
  • xml_extract_comments
  • xml_extract_cdata
• HTML Extraction Functions
  • html_extract_text
  • html_extract_links
  • html_extract_images
  • html_extract_tables
  • html_extract_table_rows
  • html_extract_tables_json
  • html_escape
  • html_unescape
  • parse_html
• Conversion Functions
  • xml_to_json
  • json_to_xml
  • to_xml
  • xml (alias)
  • Document Block Functions
  • Python xmltodict Compatibility
• Utility Functions
  • Validation
  • Analysis
  • Formatting
  • System Information

Advanced Topics

• Parameters Reference
  • Common Parameters
  • Schema Inference Parameters
  • Type Handling Parameters
  • Attribute Handling Parameters
  • Namespace Parameters
  • Empty Element Handling
  • Multi-File Parameters
  • Datetime Format Parameter
  • Examples
• Schema Inference
  • Overview
  • Phase 1: Identify Records
  • Phase 2: Identify Columns
  • Phase 3: Infer Types
  • Controlling Depth
  • SAX Streaming and Schema Inference
  • Common Patterns
• XPath Guide
  • Basic Syntax
  • Path Expressions
  • Attribute Selection
  • Predicates
  • Namespace Handling
  • Common Functions
  • Examples
• Namespace Handling
  • Understanding XML Namespaces
  • Namespace Handling in read_xml
  • Namespace Handling in xml_to_json
  • XPath and Namespaces
  • Discovering Namespaces
  • Common Patterns
  • Best Practices

About

• Changelog
• Contributing

Features

XML & HTML Processing

• Parse and validate XML/HTML documents

• Extract data using XPath expressions

• Convert between XML, HTML, and JSON formats

• Read files directly into DuckDB tables

Smart Schema Inference

• Automatically flatten XML documents into relational tables

• Intelligent type detection (dates, numbers, booleans)

• Configurable element and attribute handling

Production Ready

• Built on libxml2 for robust parsing

• Comprehensive error handling

• Memory-safe RAII implementation

• 58 test suites with 1901 assertions

Indices and tables

• Index

• Search Page