PinnedPublished inGeek CultureMy Guide to Becoming a “Market-Ready” Data Engineer With a $100 Investment in 3 Months or Less —…As you may know, the demand for Data Engineers has quadrupled in the last 2 years. There are more jobs than candidates in the job market…Jan 25, 20213Jan 25, 20213
Why Databricks Unity Catalog Managed Tables Are Better Than External TablesMy Journey with Unity Catalog Managed Tables15h ago15h ago
Choosing the Right Data Storage Platform in Data EngineeringOne of the most critical decisions in data engineering is selecting the right data storage platform. With so many options available, it’s…2d ago2d ago
🚀 Is Apache Spark Really Dying? Let’s TalkThe world of data engineering moves fast. Every few months, a new tool emerges, claiming to be the next big thing.5d ago5d ago
Published inGeek CulturePandas vs. Polars: Which Python Data Library Should You Use?If you work with data in Python, chances are you’ve used Pandas — the go-to library for data manipulation. But have you heard of Polars…Mar 4Mar 4
The Power of Naming Conventions in Data Engineering in DatabricksIn data engineering, small details can make a huge difference. One of the most valuable lessons I’ve learned from working in a mature data…Feb 27Feb 27
Common Mistakes Data Analysts Make When Building Their First Data Pipeline (And How to Avoid Them)Feb 26Feb 26
🚀 Struggling with Slow Databricks Pipelines?If you’re new to Databricks as a data engineer, one of the first challenges you’ll face is slow-running pipelines — and trust me, at some…Feb 25Feb 25
8 Timeless Data Engineering Optimization Techniques That Work Across Any Tech StackData engineering is an ever-evolving field, with new tools and frameworks emerging rapidly. However, no matter the technology stack, some…Feb 23Feb 23
Mastering Delta Table Vacuum Strategy: A Hidden Gem for Cost Optimization in DatabricksOne of the easiest (yet often overlooked) cost-saving strategies for Databricks workloads is mastering your Delta Table vacuum strategy. 💡Feb 17Feb 17