IngestThis
BLOG
COMMUNITY
PODCAST

Tag: Compaction

2026-08-04 • Alex Merced

Autonomous Table Optimization When Your Query Workload Stops Being Predictable

Autonomous table optimization when query workloads stop being predictable: observing file layout and query patterns, sco...

2025-09-16 • Alex Merced

The Endgame – Building an Autonomous Optimization Pipeline for Apache Iceberg

Learn how to automate compaction, snapshot expiration, and layout optimization in Apache Iceberg using metadata-driven t...

2025-09-09 • Alex Merced

Managing Large-Scale Optimizations – Parallelism, Checkpointing, and Fail Recovery

Learn how to scale Apache Iceberg table optimizations across large datasets using parallelism, checkpointing, and fail r...

2025-09-02 • Alex Merced

Hidden Pitfalls – Compaction and Partition Evolution in Apache Iceberg

Partition evolution in Apache Iceberg is a powerful feature, but if not managed carefully, it can introduce fragmentatio...

2025-08-26 • Alex Merced

Using Iceberg Metadata Tables to Determine When Compaction Is Needed

Discover how to use Apache Iceberg's metadata tables to proactively detect small files, bloated manifests, and table fra...

2025-08-19 • Alex Merced

Designing the Ideal Cadence for Compaction and Snapshot Expiration

Learn how to design an effective schedule for compaction and snapshot expiration in Apache Iceberg to balance cost, perf...

2025-07-29 • Alex Merced

Optimizing Compaction for Streaming Workloads in Apache Iceberg

Learn how to design fast, incremental compaction strategies in Apache Iceberg to support high-throughput streaming pipel...

Categories

data engineering
oltp
database
data
frontend
data lakehouse
Data Engineering
Data Lakehouse
Javascript
Data Architecture
Data Analytics
Devops
Data Modeling
DevOps
python
sql
rust
AI
Apache Iceberg
Software Development
Semantic Layer
Agentic Analytics
Agentic Lakehouse
AI & Machine Learning
AI Tools & Software Development
Artificial Intelligence
AI & Agents
Data Platforms
Open Source
Lakehouse
Agentic AI
Apache Arrow
Apache Parquet
Apache Polaris
AI & Society
MCP
Security & Governance
Technology & Culture
Hardware
AI & Security
TopicsData EngineeringApache IcebergData LakehouseAI & Machine Learning
SiteAll ArticlesRSS FeedSitemap
AuthorAlex MercedLinkedInTwitter / X

The Alex Merced Network

  • AlexMerced.com
  • WhoIsAlexMerced.com
  • AlexMercedMedia.com
  • Books
  • AlexMercedCoder.dev
  • AlexMercedData.com
  • DataLakehouseHub.com
  • IcebergLakehouse.com
  • AgenticLakehouse.com
  • SemanticLakehouse.com
  • DataEngnr.com
  • AlexMerced.blog
  • GrokOverflow.com

Events & Community

  • Agentic Lakehouse Events
  • Data Lakehouse Hub Events
  • Data Lakehouse Hub Slack
  • Data Events Slack
  • Data & Tech Slack
  • r/datalakehouseandai
  • Data Lakehouse Hub on LinkedIn
  • Alex Merced Tech
  • Alex Merced Data & AI

© 2026 Alex Merced — alexmercedcoder.dev

The views, thoughts, and opinions expressed on this site belong solely to Alex Merced and do not represent the views of any organization or employer.