azure databricks

Enhancing Your Data Analytics Infrastructure with Databricks Data Lakehouse

Introduction Data is an indispensable part of our world, and businesses generate a wealth of it every day. These come from various sources and serve a wide range of purposes from streaming data in real time, batch processing large amounts of data at once, to driving Artificial Intelligence (AI)[1]. Data can be a goldmine of…

azure databricks

Delta table operations on Azure Databricks

Introduction Delta tables, combined with the power of PySpark, offer a comprehensive solution for managing big data workloads. In this post, we will explore the fundamentals of Delta tables and understand how we can interact with them using PySpark. We will take some code from my previous post Ingest data from an API with Databricks…