Latest
All Posts
98 published posts
How to Reduce Databricks Costs Beyond the Easy Wins
The quick wins cap out fast. Learn how to reduce Databricks costs beyond them by optimizing what your jobs do, with real numbers from production pipelines.
Databricks Lakebase? What Every Engineer Needs to Know
Databricks Lakebase explained: how the bidirectional Postgres sync works, autoscaling vs provisioned, what it won't give you, and what it really costs
Databricks Genie Cost Optimization: How to Track and Control What It Triggers
Genie's AI usage is easy to track. The compute it triggers isn't. Here's how to make Genie's Databricks cost optimization attributable before the bill arrives.
Databricks Genie Explained: What It Is and Which Tool to Use
Databricks Genie now spans four tools: Genie One, Genie Agents, Genie Code, and Genie Ontology. See what each does, what it costs, and which one to use first
Databricks Cost Optimization, Actually Explained
A practitioner-tested databricks cost optimization framework covering waste, compute sizing, workflow design, storage, and governance, with real numbers
Why We Built SELECT for Databricks
Ian Whitestone explains why SELECT expanded to Databricks: multi-platform cost visibility, compute complexity, and what that means for your data team's spend.
Databricks Agent Bricks: What It Is and How It Works in Production
Databricks Agent Bricks explained: how it governs production AI agents, what you need to set it up, real use cases, and the AI costs it doesn't show you
Databricks Genie Pricing: What It Actually Costs to Run
Databricks Genie bills in two separate streams: LLM usage and the compute it triggers. We ran a real test to see what a Genie session actually costs.
An Engineer's Guide to Databricks Photon
Databricks Photon explained: the 2x DBU break-even math, which operators run natively, reading the query profile, and if it's actually saving you money
Databricks Pricing Explained: The 3 Controls that Actually Matter
Databricks bills you twice and DBU rates vary up to 3.5x. Learn the three cost controls that prevent most surprises: auto-termination, Job Compute, and tagging.
3 Ways to Achieve Effective Clustering in Snowflake
Pairing query design with effective clustering can dramatically improve pruning and query speeds. We'll explore how and when you should leverage this powerful Snowflake feature, and the three ways you can effectively cluster your tables.
Micro-Partitions: Understanding Snowflake's File Structure
Independently scalable compute and storage is an architecture fundamental of Snowflake. In this post, we’ll be focusing on how Snowflake stores data, and how it can greatly accelerate query performance.