Key Responsibilities

● Develop and maintain data ingestion pipelines in Azure Databricks.

● Perform data transformation and preparation tasks.

● Validate data accuracy, completeness, and quality.

● Troubleshoot data pipeline issues and ensure stable operations.

● Collaborate with the team to optimize workflows and improve performance.

● Work closely with cross-functional teams to support project requirements.

Required Qualifications

● 4–5 years of relevant experience in data engineering, cloud data platforms, or similar roles.

● Strong hands-on experience with Azure Databricks.

● Experience in data ingestion and transformation in cloud environments.

● Familiarity with Azure Data Factory, Azure Data Lake, and SQL.

● Knowledge of Azure Synapse or related Azure data services.

● Experience with data validation frameworks or automated testing.

● Experience with Delta Lake (data versioning and performance optimization).

● Strong analytical and problem-solving skills.

● Ability to work with distributed data pipelines and large datasets.

● Good communication and teamwork skills.