Data-Engineering
Datagrunt 4.5.1: Sort-Friendly PDF Image Filenames
Datagrunt 4.5.1 gives every PDF image output file a zero-padded, 1-based filename so directory listings sort in true page order, and fixes the release pipeline so docs and blog posts publish automatically.
July 7, 2026
Datagrunt 4.5.0: High-Fidelity PDF Page Rendering and Security Hardening
Datagrunt 4.5.0 introduces whole-page rasterization via PDFWriter.render_pages_as_images, a self-generating AI release agent, and hardened CI/CD pipelines.
July 1, 2026
Datagrunt 4.4.0: Consistent Native Polars Integration
Datagrunt 4.4.0 brings unified support for native Polars keyword arguments across CSV, Excel, and Parquet readers, while deprecating the legacy Excel read_options dictionary.
June 27, 2026
Datagrunt 4.3.0: First-Class Parquet Reading and Writing
Datagrunt 4.3.0 adds ParquetReader and ParquetWriter — read Parquet files into DataFrames, dicts, Arrow, or SQL, and export them to CSV, JSON, JSONL, Excel, or Parquet, with compression passthrough.
June 26, 2026
Datagrunt 4.2.0: First-Class Excel Reading and Writing
Datagrunt 4.2.0 adds ExcelReader and ExcelWriter — read .xlsx/.xls workbooks sheet by sheet into DataFrames, dicts, Arrow, or SQL, and export any sheet (or all of them) to CSV, JSON, JSONL, Parquet, or Excel.
June 25, 2026
Datagrunt 4.0: A Rust-Accelerated CSV Core and the AI Feature Removal
Datagrunt 4.0 ships a bundled Rust engine for CSV delimiter and dialect inference (~5x faster), removes the deprecated AI/LLM features, and adds document-level batch PDF processing. Plus the same-day 4.0.1 packaging and security patch.
June 13, 2026
Datagrunt Updates: Context Managers, Class-Level Normalization, and Hardening (v3.2.0 - v3.4.1)
A consolidated review of Datagrunt releases from 3.2.0 through 3.4.1, highlighting class-level column normalization, context manager support, AI feature deprecation, and key performance and correctness fixes.
June 13, 2026
Datagrunt 3.1.40: A Hardening and Performance Release
Datagrunt 3.1.40 lands 33 merged pull requests focused on correctness, robustness, security, and speed. Highlights include eliminating silent CSV data loss, fail-fast input validation, ~500x faster repeated DuckDB queries, bounded-memory sampling, thread-safe PDF execution, a contained image-dedupe security fix, and a test suite that grew from 281 to 408 tests.
June 11, 2026
Exporting PDFs to Clean Markdown: Bridging Structured PDFs and LLMs
Why we built Datagrunt's PDF-to-Markdown export capability, the value of formatted markdown for RAG and LLMs, and how it handles tables, list structures, and images under the hood.
June 7, 2026
Optimizing PDFium: Resolving Multiprocessing Overhead and Layout Parser Recursion
How we optimized datagrunt's new default PDF engine (PDFium) to run 200x faster on single-page documents and fixed a critical infinite recursion bug in layout-aware column splitting.
June 7, 2026