Databricks Data Engineer – Turn Data into Insights with Databricks

Position Available: Databricks Data Engineer
Location: Remote; Sri Lanka
Hours: Full-time – 5:30am – 1:30pm, IST Colombo

Are you a detail-oriented, analytical Databricks Data Engineer with a passion for building robust data pipelines, transforming raw data into actionable insights, and optimizing Power BI models, ready to take ownership of data engineering, platform performance, and cross-team collaboration to drive real impact?

Join Elephant Teams, a rapidly growing offshoring services company, and become an integral part of our in-house operations. If you’re detail-oriented, proactive, and passionate about people, this is an exciting opportunity to grow your career with a supportive and fast-growing team.

We are seeking a Databricks Data Engineer to build ETL/ELT pipelines, automate data ingestion, develop API integrations, transform data into analytics-ready datasets, optimize Power BI models, ensure security and compliance, and collaborate to improve data platform processes

What You’ll Be Doing:

As a Databricks Data Engineer, you'll build and maintain ETL/ELT pipelines, automate data ingestion from CSV and SharePoint, develop API integrations, transform data into analytics-ready datasets, optimize Power BI models, monitor performance, ensure security, and collaborate to improve data platform processes.

Your main responsibilities & experience:

• Data Pipeline Development - Design, develop, and maintain robust ETL/ELT pipelines in Databricks using Apache Spark, Delta Lake, and Delta Live Tables. Automate CSV ingestion from scheduled emails, build API integrations with third-party platforms and internal systems, ingest data from SharePoint folders, and implement incremental and full-load strategies tailored to each data source.
• Data Modelling & Quality - Transform raw data into clean, structured, analytics-ready datasets, enforce data quality checks, validation rules, and exception handling, and design data models optimized for Power BI reporting and analytics.
• Power BI Integration - Collaborate with report developers to deliver data in formats suitable for Power BI datasets and dataflows, optimize models and aggregations for faster, high-performance dashboards, and investigate and resolve data discrepancies in reporting.
• Platform & Operations - Manage Databricks workspace configurations, clusters, and scheduled jobs, monitor pipeline performance and reliability, proactively address failures or latency issues, maintain up-to-date documentation for pipelines and data flows, and implement best practices for data security, access control, and compliance.
• Collaboration & Continuous Improvement - Work closely with the IT Manager and business stakeholders to gather requirements and prioritize initiatives, identify opportunities to improve data platform maturity, tools, and processes, and contribute to the evaluation and adoption of new data technologies and solutions.

What your profile will look like:

• Must Have: 3+ years of experience in a data engineering or similar technical role
• Must Have: Hands-on experience with Databricks, including Notebooks, Delta Lake, and Jobs/Workflows.
• Must Have: Proficiency in Python and/or PySpark for data transformation and pipeline development.
• Must Have: Experience developing ETL/ELT pipelines from file-based sources such as CSV and Excel, as well as REST APIs.
• Must Have: Strong SQL skills for data querying, modelling, and transformation
• Must Have: Familiarity with cloud storage platforms such as Azure Data Lake Storage, AWS S3, or similar
• Must Have: Solid understanding of data warehousing concepts, tabular modelling, and lakehouse architecture
• Must Have: Experience integrating data with Power BI, including datasets, dataflows, or Direct Lake connectivity
• Preferred: Experience with dimensional modelling

Benefits of joining the Elephant Teams family:

• Fully Remote Work: WFH, always. We set you up with the equipment you need to succeed.
• Competitive Compensation: Salary aligned with your experience and skill level.
• Team Events: Regular on-the-ground events for Elephant Teams staff.
• Professional Growth: Work alongside leading Australian businesses and accelerate your career.

If you’re passionate about content and love being in the editing seat, we’d love to hear from you.

To apply and be part of something big, please submit your application, attach your resume, and answer a few quick questions to help us assess your fit for the role.

Note: You must have legal working rights in Sri Lanka, and be living in Sri Lanka, to apply for this role