PinnedPublished inGeek CultureMy Guide to Becoming a “Market-Ready” Data Engineer With a $100 Investment in 3 Months or Less —…As you may know, the demand for Data Engineers has quadrupled in the last 2 years. There are more jobs than candidates in the job market…Jan 25, 20213Jan 25, 20213
Mastering Delta Table Vacuum Strategy: A Hidden Gem for Cost Optimization in DatabricksOne of the easiest (yet often overlooked) cost-saving strategies for Databricks workloads is mastering your Delta Table vacuum strategy. 💡4d ago4d ago
The Hidden Power of Shell Scripting for Data EngineersWhen I started as a data engineer, I didn’t think much about shell scripting. With so many orchestration tools offering sleek UIs…6d ago6d ago
Things I wish I knew about Data Engineering — Data LifecyleAs a data engineer, continuous learning is key to staying ahead in this ever-evolving field. Recently, I’ve been diving into the…Feb 14Feb 14
🚀 Future-Proofing Your Data Engineering Career: How to Stay Ahead in the Age of AI Coders! 🔥The rise of AI coding assistants like Copilot and ChatGPT has revolutionized how we write code. These tools can generate boilerplate…Feb 12Feb 12
Want to Break into Data Engineering? Here’s Where to Start!One of the most common questions I get is:Feb 8Feb 8
The One Question That Surprised Me During a Data Engineering TalkLast year, I had the opportunity to present to a group of middle school students about data engineering. I expected questions about coding…Feb 7Feb 7
The Hidden Complexity of Data Engineering: Why You Should Always Add Buffer Time🚀 Ever thought a data pipeline would take an hour… only to lose half your day debugging?Feb 5Feb 5
Why Inheritance in Programming Can Be a Bad IdeaInheritance is one of the fundamental concepts of Object-Oriented Programming (OOP). At first glance, it seems like a great way to promote…Feb 4Feb 4
PySpark vs. Spark SQL: A Love-Hate RelationshipI don’t know who this might offend, but I have to say it — I hate PySpark.Jan 311Jan 311