PinnedPublished inGeek CultureMy Guide to Becoming a “Market-Ready” Data Engineer With a $100 Investment in 3 Months or Less —…As you may know, the demand for Data Engineers has quadrupled in the last 2 years. There are more jobs than candidates in the job market…Jan 25, 20213Jan 25, 20213
Databricks Managed Tables vs External Tables Pros and ConsAdvantages of Databricks Managed Tables:Sep 271Sep 271
Implementing Slowly Changing Dimension (SCD) Type 2 for specific fields while performing Type 1…When working with Slowly Changing Dimensions (SCD), implementing Type 2 can be crucial to track historical data changes over time. This…Sep 15Sep 15
Databricks Workflow — Why, When and TipsDatabricks Workflows orchestrate data processing, machine learning, and analytics pipelines on the Databricks Data Intelligence Platform…Jul 6Jul 6
Customer Obsession vs. Competitor Obsession: A Call to Action for Data Analytics and AI CompaniesThere are few quotes as impactful as Jeff Bezos’ revelation that the secret to Amazon’s success lies in their customer obsession. This…Jun 21Jun 21
Optimizing Merge Statements in Databricks: Strategies for EfficiencyIf your Merge statement is taking as much time or more to complete compared to a full table rewrite, it indicates an optimization issue. In…Jun 16Jun 16
Cost Optimization for Databricks Clusters: A Data Engineer’s ApproachAs a data engineer, finding ways to save costs for your employer while using Databricks is essential. Here’s my approach, focusing on…May 25May 25
How to run Azure Databricks workflow Job as service principal (with video)As Databricks evolves and continues to add more features to its platform, administration becomes increasingly crucial and daunting. There’s…May 12May 12
Data Engineers Ace Python Coding Interviews NOW!If I’m honest, I could have landed a job at a MAANG company by now if I had spent enough time practicing coding assessments for data…Apr 71Apr 71