Lead Data Engineer - Spark, Scala
at Societe Generale
Posted 2 days ago
No clicks
- Compensation
- Not specified
- City
- Bengaluru
- Country
- India
Currency: Not specified
Design, development and testing of components and modules involving Spark, Scala, Hive and related big-data technologies in a datalake architecture. Implement design, development and deployment of new Data pipelines and maintain the existing ones. Lead migrations such as move to public cloud (Azure) and version upgrades, and oversee a team of Data Engineers located in both offshore and onshore. Deploy data views plugged by Data Visualization tools such as Power BI and follow CD/CI practices across development, UAT and production environments, ensuring craftsmanship and Agile@Scale processes.
Responsibilities<\/p>
- Design, development and testing of components \/ modules involving Spark, Scala, Hive\u00a0and related big-data technologies in a datalake architecture<\/li>
- Implement design, development and deployment of new Data pipelines and maintain the existing ones.<\/li>
- Lead migrations such as move to public cloud ( Azure ), version upgrades.<\/li>
- Oversee team of Data Engineers located in both offshore and onshore.<\/li>
- Building views that are plugged by Data Visualization tools such as Power BI Release & Deployment \u2013 Deploy using CD\/CI practices and tools in various environments \u2013 development, UAT and production and follow production processes.<\/li>
- Ensure Craftsmanship practices are followed.<\/li>
- Follow Agile@Scale process in terms of participation in PI Planning and follow-up, Sprint planning, Back-log maintenance in Jira.<\/li>
- Develop\/propose tactical solutions for Project specific needs<\/li><\/ul><\/p>Profile required
- 7 + years of experience as a Data Engineer<\/li>
- Architect, Design, Develop code on Spark, Scala, Hive, any big data ecosystem,\u00a0
Python, SQL, Design Patterns, Design Principles and Functional Patterns .<\/li> - Good understanding of ETL Processes and data warehousing concepts, API's<\/li>
- Expertise in Spark, Scala, Unix Shell Scripting<\/li>
- Good Hands on SQL, experience of Power BI will be added advantage.<\/li>
- Working experience on public Cloud preferably on Azure will be an added advantage.<\/li>
- Should have experience on Releasing, CI\/CD, Git and JIRA<\/li>
- Good analytical and troubleshooting skills to resolve the issues in timebound manner.<\/li>
- Effective team player with ability work autonomously and in team with cross-cultural environment<\/li>
- Effective verbal and written communication to work closely with all the stakeholders<\/li> <\/ul>
Mandatory Skills:<\/p>
Should be strong in Spark, Scala, Hive, SQL, Data Modeling<\/p>
Good to Have Skills:<\/p>
Azure, Databricks, Python, BI Reporting, AI<\/p>
CI\/CD, AGILE<\/p><\/p>Why join us
\"We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status\"<\/i><\/p>Business insight
At Soci\u00e9t\u00e9 G\u00e9n\u00e9rale, we are convinced that people are drivers of change, and that the world of
tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious.<\/p>Whether you\u2019re joining us for a period of months, years or your entire career, together we can have
a positive impact on the future. Creating, daring, innovating and taking action are part of our DNA.
If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a
daily basis and develop or strengthen your expertise, you will feel right at home with us!
Still hesitating?
You should know that our employees can dedicate several days per year to solidarity actions during
their working hours, including sponsoring people struggling with their orientation or professional
integration, participating in the financial education of young apprentices and sharing their skills with
charities. There are many ways to get involved.<\/p>We are committed to support accelerating our Group\u2019s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.<\/strong><\/strong><\/p>
<\/strong><\/p>","identifier":{"@type":"PropertyValue","name":"Recruitment Societe Generale","value":"250003AA"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Bangalore","addressCountry":"India"}}} window.dataLayer = window.dataLayer || []; var aData = { customVarPage1: "Lead Data Engineer - Spark, Scala", customVarPage2: "Bangalore", customVarPage3: "Permanent contract", customVarPage4: "250003AA", customVarPage5: "SG Global Solution Centre", customVarPage6: "IT (Information Technology)", customVarPage7: "2025/10/31" } window.dataLayer.push(aData);
{ "@context": "https://schema.org", "@type": "BreadcrumbList", "itemListElement": [ { "@type": "ListItem", "position": 1, "name": "Home", "item": "https://careers.societegenerale.com/en" } , { "@type": "ListItem", "position": 2, "name": "Job offers", "item": "https://careers.societegenerale.comhttps://careers.societegenerale.com/en/search" } , { "@type": "ListItem", "position": 3, "name": "Lead Data Engineer - Spark, Scala", } ] }Back to offersLead Data Engineer - Spark, Scala
IT (Information Technology)ApplyAdd to favoritesPermanent contractBangalore, IndiaReference 250003AAStart date ImmediatelyPublication date 2025/10/31Responsibilities
Responsibilities
- Design, development and testing of components / modules involving Spark, Scala, Hive and related big-data technologies in a datalake architecture
- Implement design, development and deployment of new Data pipelines and maintain the existing ones.
- Lead migrations such as move to public cloud ( Azure ), version upgrades.
- Oversee team of Data Engineers located in both offshore and onshore.
- Building views that are plugged by Data Visualization tools such as Power BI Release & Deployment – Deploy using CD/CI practices and tools in various environments – development, UAT and production and follow production processes.
- Ensure Craftsmanship practices are followed.
- Follow Agile@Scale process in terms of participation in PI Planning and follow-up, Sprint planning, Back-log maintenance in Jira.
- Develop/propose tactical solutions for Project specific needs
Profile required
- 7 + years of experience as a Data Engineer
- Architect, Design, Develop code on Spark, Scala, Hive, any big data ecosystem,
Python, SQL, Design Patterns, Design Principles and Functional Patterns . - Good understanding of ETL Processes and data warehousing concepts, API's
- Expertise in Spark, Scala, Unix Shell Scripting
- Good Hands on SQL, experience of Power BI will be added advantage.
- Working experience on public Cloud preferably on Azure will be an added advantage.
- Should have experience on Releasing, CI/CD, Git and JIRA
- Good analytical and troubleshooting skills to resolve the issues in timebound manner.
- Effective team player with ability work autonomously and in team with cross-cultural environment
- Effective verbal and written communication to work closely with all the stakeholders
Mandatory Skills:
Should be strong in Spark, Scala, Hive, SQL, Data Modeling
Good to Have Skills:
Azure, Databricks, Python, BI Reporting, AI
CI/CD, AGILE
Why join us
"We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status"
Business insight
At Société Générale, we are convinced that people are drivers of change, and that the world of
tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious.Whether you’re joining us for a period of months, years or your entire career, together we can have
a positive impact on the future. Creating, daring, innovating and taking action are part of our DNA.
If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a
daily basis and develop or strengthen your expertise, you will feel right at home with us!
Still hesitating?
You should know that our employees can dedicate several days per year to solidarity actions during
their working hours, including sponsoring people struggling with their orientation or professional
integration, participating in the financial education of young apprentices and sharing their skills with
charities. There are many ways to get involved.We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.
Diversity and Inclusion
We are an equal opportunities employer and we are proud to make diversity a strength for our company. Societe Generale is committed to recognizing and promoting all talents, regardless of their beliefs, age, disability, parental status, ethnic origin, nationality, gender identity, sexual orientation, membership of a political, religious, trade union or minority organisation, or any other characteristic that could be subject to discrimination.TitreSimilar jobsTitreJobs & contracts- Home
- Job offers
- Lead Data Engineer - Spark, Scala
