Senior Data Engineer – Databricks / Python / PySpark

CoreKonnect is seeking a Senior Data Engineer with strong experience in Databricks, Python, and PySpark to design and maintain scalable enterprise data pipelines. This role will focus on building robust data frameworks, implementing Medallion architecture, and enabling large-scale analytics platforms.

Key Responsibilities

  • Build and maintain data pipelines and ingestion frameworks in Databricks.
  • Design scalable data processing frameworks across medallion architecture layers.
  • Integrate enterprise data platforms with reference architecture and data mesh frameworks.
  • Support teams with best practices for onboarding to new data platforms.
  • Implement streaming data ingestion using Kafka and orchestrate pipelines with tools like Airflow.

Key Requirements

  • 8+ years of data engineering experience.
  • Strong expertise in Python, PySpark, SQL, and Pandas.
  • Experience with Databricks Lakehouse platform (preferably on Azure).
  • Knowledge of data modelling, CI/CD, DevOps, and API-based integrations.
  • Experience working in Agile environments with tools such as Jira and Confluence.
  • Financial services or capital markets experience is preferred.
Why CoreKonnect?

You're more than your skills
and your recruiter should act like a partner, not a salesperson.

We're a human-first recruitment agency — empowering people and elevating business through meaningful opportunities.

Find Work