Specialist Software Engineer - Big Data Engineering
at Societe Generale
Posted 2 days ago
No clicks
- Compensation
- Not specified
- City
- Bengaluru
- Country
- India
Currency: Not specified
As a Specialist Software Engineer - Big Data Engineering, you will identify and ingest data sources into the data lake, design the structure and organization of data for accessibility and performance, and develop ETL pipelines using PySpark for cleaning, transforming, and integrating data from multiple sources. You will configure ETL elements such as formatting, deduplication, volumetric analysis, and enrichment, while documenting pipeline logic and transformation rules for transparency. You will contribute to new data use cases, build interactive dashboards to visualize key metrics, and monitor data workflows in production to ensure reliability and data accuracy.
\u00b7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Identify and select relevant data sources to be ingested into the data lake based on business and analytical needs.<\/p>
\u00b7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Design and manage the structure and organization of data within the data lake to ensure accessibility, scalability, and performance.<\/p>
\u00b7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Develop and maintain ETL pipelines using PySpark for data cleaning, transformation, and integration across multiple sources.<\/p>
\u00b7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Implement ETL configuration elements such as data formatting, deduplication, volumetric analysis, and enrichment, ensuring comprehensive documentation is maintained.<\/p>
\u00b7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Contribute to the definition and design of new use cases by identifying relevant data, transforming it, and preparing it for analysis.<\/p>
\u00b7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Develop and maintain interactive dashboards that visualize key metrics and insights derived from processed data<\/p>
\u00b7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Monitor and troubleshoot data workflows to ensure reliability and accuracy in production environments.<\/p>
\u00b7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Document pipeline logic, data sources, and transformation rules for transparency and maintainability.<\/p>Profile required
Technical Skills<\/strong><\/p> Proficiency in Python and PySpark for data processing.<\/p> Strong SQL skills and experience with relational databases.<\/p> Experience with dashboarding tools will be a plus (e.g., Power BI, Tableau...).<\/p> Familiarity with data warehousing (Cloudera)<\/p> Understanding of data modeling, data lakes, and data governance.<\/p> Soft Skills<\/strong><\/p> Strong analytical and problem-solving abilities.<\/p> Excellent communication skills to collaborate with technical and non-technical stakeholders.<\/p> Ability to manage multiple tasks and prioritize effectively.<\/p> Detail-oriented with a focus on data accuracy and usability.<\/p> Preferred Qualifications<\/strong><\/p> Bachelor\u2019s or Master\u2019s degree in Computer Science, Data Science, or related field.<\/p> Fluent English is a must; French will be a plus, but not mandatory<\/p> Knowledge of business intelligence and data storytelling principles.<\/p>Why join us \u201cWe are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status\u201d<\/p>Business insight At Soci\u00e9t\u00e9 G\u00e9n\u00e9rale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious.<\/p> Whether you\u2019re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating and taking action are part of our DNA.<\/p> If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!<\/p> Still hesitating?<\/p> You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices and sharing their skills with charities. There are many ways to get involved.<\/p> We are committed to support accelerating our Group\u2019s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.<\/p>","identifier":{"@type":"PropertyValue","name":"Recruitment Societe Generale","value":"25000PWC"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Bangalore","addressCountry":"India"}}} window.dataLayer = window.dataLayer || []; var aData = { customVarPage1: "Specialist Software Engineer - Big Data Engineering", customVarPage2: "Bangalore", customVarPage3: "Permanent contract", customVarPage4: "25000PWC", customVarPage5: "SG Global Solution Centre", customVarPage6: "IT (Information Technology)", customVarPage7: "2026/02/05" } window.dataLayer.push(aData); · Identify and select relevant data sources to be ingested into the data lake based on business and analytical needs. · Design and manage the structure and organization of data within the data lake to ensure accessibility, scalability, and performance. · Develop and maintain ETL pipelines using PySpark for data cleaning, transformation, and integration across multiple sources. · Implement ETL configuration elements such as data formatting, deduplication, volumetric analysis, and enrichment, ensuring comprehensive documentation is maintained. · Contribute to the definition and design of new use cases by identifying relevant data, transforming it, and preparing it for analysis. · Develop and maintain interactive dashboards that visualize key metrics and insights derived from processed data · Monitor and troubleshoot data workflows to ensure reliability and accuracy in production environments. · Document pipeline logic, data sources, and transformation rules for transparency and maintainability. Technical Skills Proficiency in Python and PySpark for data processing. Strong SQL skills and experience with relational databases. Experience with dashboarding tools will be a plus (e.g., Power BI, Tableau...). Familiarity with data warehousing (Cloudera) Understanding of data modeling, data lakes, and data governance. Soft Skills Strong analytical and problem-solving abilities. Excellent communication skills to collaborate with technical and non-technical stakeholders. Ability to manage multiple tasks and prioritize effectively. Detail-oriented with a focus on data accuracy and usability. Preferred Qualifications Bachelor’s or Master’s degree in Computer Science, Data Science, or related field. Fluent English is a must; French will be a plus, but not mandatory Knowledge of business intelligence and data storytelling principles. “We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status” At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us! Still hesitating? You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices and sharing their skills with charities. There are many ways to get involved. We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection. Specialist Software Engineer - Big Data Engineering
Responsibilities
Profile required
Why join us
Business insight
Diversity and Inclusion





