ETL Testing with Azure Databricks
at Capgemini
Posted 6 days ago
No clicks
- Compensation
- Not specified
- City
- Bengaluru
- Country
- India
Currency: Not specified
Experienced ETL Tester with strong Azure Databricks expertise to validate data pipelines, transformations, and integrations on Azure cloud platforms. The role involves validating big-data workflows, writing SQL/PySpark queries, and ensuring high data quality across data lake and data warehouse environments. Responsibilities include hands-on validation of components such as Azure Data Factory pipelines, ADLS, and Synapse Analytics, plus end-to-end ingestion patterns.
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Your Role
- Strong experience in ETL testing in cloud data environments.
- Practical experience working with Databricks Notebooks (PySpark/SQL) for data validation.
- trong expertise in advanced SQL, including complex joins, aggregations, windows functions, and analytical queries.
- Experience with databases such as Azure SQL Database, Synapse SQL, SQL Server, Snowflake, or similar.
- Hands-on validation of components such as Azure Data Factory (ADF) pipelines, Azure Data Lake Storage (ADLS), Azure Synapse Analytics
Understanding of end-to-end Azure data ecosystem and ingestion patterns.
Your Profile
- Basic Python or PySpark scripting experience for data validation.
- Exposure to CI/CD pipelines (Azure DevOps, Git).
- Knowledge of Data Quality frameworks (Great Expectations, Deequ, etc.) — optional.
- Understanding of API testing using Postman/Swagger (if integrated with pipelines).
- Experience with BI tools (Power BI, Tableau) for end-report validation.
- Knowledge of Agile/Scrum processes.
What you will love about working here
- You can shape your career with us. We offer a range of career paths and internal opportunities within Capgemini group. You will also get personalized career guidance from our leaders.
- You will get comprehensive wellness benefits including health checks, telemedicine, insurance with top-ups, elder care, partner coverage or new parent support via flexible work.
- At Capgemini, you can work on cutting-edge projects in tech and engineering with industry leaders or create solutions to overcome societal and environmental challenges.
Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion.
Make it real | www.capgemini.com
