List: Databricks | Curated by Daniel Mannino

Feb 3, 2025
23 stories
Databricks
Abhinav Prakash
Databricks: A comprehensive optimization guideI have been using Databricks for ETL workloads for 4 years now. In these 4 years, I have come across optimization techniques in bits and…
Feb 2, 2024
1
Feb 2, 2024
1
In
DBSQL SME Engineering
by
Databricks SQL SME
Optimizing Databricks Storage with Vacuuming Strategies, Predictive Optimization, and Smarter Data…Author
Jan 10
2
Jan 10
2
In
overcast blog
by
DavidW (skyDragon)
Databricks Cost Optimization: 11 Things You Should KnowOptimizing costs on Databricks isn’t just a nice-to-have — it’s essential. Whether you’re managing a sprawling data lake or running…
Aug 6, 2024
4
Aug 6, 2024
4
Amr Ali
Delta Sharing: How to save on egress costs using cached data and incremental Change Data Feeds?Data sharing is becoming increasingly vital to the modern data stack, enabling teams to collaborate, analyse, and derive insights from…
Apr 19, 2023
1
Apr 19, 2023
1
In
Python in Plain English
by
Sushil Kumar
The Impact of Row and Column Level Security with Databricks Unity Catalog on Query PerformanceDatabricks Unity Catalog offers a centralized governance platform that provides robust security features, including row and column-level…
Sep 25, 2024
2
Sep 25, 2024
2
In
Towards Dev
by
Avin Kohale
Serverless compute in DatabricksGo serverless in Databricks!! Read to know more.
Sep 12, 2024
2
Sep 12, 2024
2
In
Towards Dev
by
Avin Kohale
Databricks LakeFlow overviewLakeFlow is here guys! Its gonna change how we create ETL as we as how we orchestrate it! Dont believe me? Have a read yourself.
Jul 11, 2024
6
Jul 11, 2024
6
Hitesh Parab
How to Read Databricks Tables from Snowflake using IcebergDid you know Snowflake can now connect directly to Databricks Unity Catalog? This exciting integration makes it easier than ever to access…
Nov 22, 2024
Nov 22, 2024
Nidhi Gupta
Liquid Clustering on Databricks (Databricks Runtime 13.3 and above)I've been working on a project where I encountered difficulty handling a large amount of data that streams into a delta table on an hourly…
Jun 16, 2024
Jun 16, 2024
Tony Siciliani
Liquid Clustering with Databricks Delta LakeDatabricks unveiled Liquid Clustering at this year’s Data + AI Summit, a new approach aimed at improving both read and write performance…
Jul 3, 2023
4
Jul 3, 2023
4
Hugo Lu
Snowflake vs. Databricks 2024 (actually useful)Snowflake vs. Databricks is something we’ve all heard before, so why not take a different approach
Aug 8, 2024
7
Aug 8, 2024
7
In
MLOps.io
by
The MLOps Guy
Databricks Lakehouse Monitoring: A Practical Hands-On GuideDatabricks Lakehouse Monitoring lets you monitor the statistical properties and quality of the data in all of the tables in your databricks…
Aug 17, 2024
2
Aug 17, 2024
2
Mariusz Kujawski
Unity Catalog on Databricks: Mastering Data GovernanceUnity Catalog is a comprehensive governance solution for data and AI on Databricks, adding an extra layer of security for accessing data…
Jun 3, 2024
1
Jun 3, 2024
1
Paul Needleman
Databricks vs (Optimized) Snowflake by the numbersI am a Principal Solutions Architect at Snowflake with 17 years of data strategy, architecture, and engineering experience. The views…
Nov 6, 2024
7
Nov 6, 2024
7
Guillermo Musumeci
How to Optimize and Reduce the Cost of Azure Databricks Clusters up to 90%Over the last few months, I optimized Azure Databricks Clusters, reducing expenses by 92% and saving around 190K/year in a single cluster.
Apr 26, 2024
3
Apr 26, 2024
3
In
DBSQL SME Engineering
by
Jason Drew
Performance of Querying Uniform-Iceberg Tables in Snowflake written by DatabricksBackground
Feb 8, 2024
2
Feb 8, 2024
2
Usman Zubair
Achieving Open Lakehouse Interoperability with Delta UniFormHow to integrate Snowflake with Databricks Unity Catalog to refresh Iceberg table metadata
Feb 9, 2024
1
Feb 9, 2024
1
Nick Akincilar
Concurrency really matters for SQL Data Warehouse workloads!There is a lot of talk about what you really need to have an analytics driven organization when it comes to the underlying data platform…
Jul 15, 2022
1
Jul 15, 2022
1
In
TDS Archive
by
Gianpi Colonna
Optimizing Output File Size in Apache SparkA Comprehensive Guide on Managing Partitions, Repartition, and Coealesce Operations
Aug 11, 2023
4
Aug 11, 2023
4
Riya Khandelwal
Delta Live Tables : Simplify the ETL ProcessDatabricks Delta Live Tables provide one of the key solution to build and manage, reliable and robust data engineering pipelines that can…
Apr 13, 2023
2
Apr 13, 2023
2