Python Developer for Data Engineering
at MSCI
Posted 8 hours ago
No clicks
- Compensation
- Not specified
- City
- Mumbai
- Country
- India
Currency: Not specified
Join MSCI's Data Engineering group in Mumbai to design and build AI-powered automation for data onboarding, metadata-driven data platforms, and scalable ingestion pipelines. You will work on LLM-integrated code generation for ingestion pipelines, PySpark transformations, and Airflow DAGs, while developing metadata management platforms and RESTful APIs integrating AI services with Snowflake and Databricks. You will contribute to end-to-end automation across data engineering, governance, and product teams, building fault-tolerant systems for large-scale metadata processing. This is a greenfield opportunity to reduce manual effort and accelerate vendor onboarding, with a focus on data quality and reliability.
Your Team Responsibilities
The Data Engineering group within MSCI is responsible for delivering data products to MSCI's product lines globally. We're building a next-generation metadata-driven data platform that uses AI to automate and scale data onboarding. As part of a talented software development team in Mumbai, you'll have the opportunity to design and build state-of-the-art automation solutions that transform how MSCI ingests, governs, and delivers data to the investment community. This is a greenfield opportunity to architect systems that will reduce manual effort by 40-60% and accelerate vendor onboarding by 50-70%.
Your Key Responsibilities
- Design and develop AI-powered automation capabilities for data onboarding, including vendor file classification, metadata auto-suggestion, data profiling engines, and automated quality control frameworks
- Build LLM-integrated code generation systems for ingestion pipelines, PySpark transformations, and Airflow DAG orchestration
- Implement metadata management platforms that serve as the control plane for data lifecycle automation
- Develop RESTful APIs and integration layers connecting AI services, data platforms (Snowflake, Databricks), and orchestration frameworks
- Create human-in-the-loop workflows for validation, exception handling, and continuous model improvement
- Collaborate with cross-functional teams across data engineering, governance, and product to deliver end-to-end automation solutions
- Build scalable, fault-tolerant systems designed for metadata processing at scale
Your skills and experience that will help you excel
Required:
- 5-8 years of software development experience with strong Python programming expertise
- Knowledge of data manipulation libraries (Pandas, Polars) and analysis workflows
- Proficiency in SQL and data querying across modern data platforms
- Understanding of columnar storage formats and time-series analytics (ClickHouse, Parquet, Iceberg)
- Experience with AI-assisted development tools (GitHub Copilot, Cursor, or similar)
- Strong understanding of RESTful API design and implementation
- Experience with Git version control and collaborative development workflows
- Demonstrated ability to take ownership of complex technical solutions end-to-end
- Strong analytical and problem-solving skills with attention to data quality and reliability
Preferred:
- Hands-on experience with LLMs (OpenAI, Anthropic, or open-source models) and prompt engineering
- Familiarity with Agentic AI frameworks and orchestration patterns
- Experience with cloud platforms (Azure or GCP) and modern data infrastructure
- Exposure to financial concepts, reference data, or market data processing
- Experience building metadata-driven or self-service data platforms
About MSCI
What we offer you
- Transparent compensation schemes and comprehensive employee benefits, tailored to your location, ensuring your financial security, health, and overall wellbeing.
- Flexible working arrangements, advanced technology, and collaborative workspaces.
- A culture of high performance and innovation where we experiment with new ideas and take responsibility for achieving results.
- A global network of talented colleagues, who inspire, support, and share their expertise to innovate and deliver for our clients.
- Global Orientation program to kickstart your journey, followed by access to our Learning@MSCI platform, AI Learning Center , LinkedIn Learning Pro and tailored learning opportunities for ongoing skills development.
- Multi-directional career paths that offer professional growth and development through new challenges, internal mobility and expanded roles.
- We actively nurture an environment that builds a sense of inclusion belonging and connection, including eight Employee Resource Groups. All Abilities, Asian Support Network, Black Leadership Network, Climate Action Network, Hola! MSCI, Pride & Allies, Women in Tech, and Women’s Leadership Forum.
At MSCI we are passionate about what we do, and we are inspired by our vision – to power better decisions. You’ll be part of an industry-leading network of creative, curious, and entrepreneurial pioneers. This is a space where you can challenge yourself, set new standards and perform beyond expectations for yourself, our clients, and our industry.
MSCI strengthens global markets by connecting participants across the financial ecosystem with a common language. Our research-based data, analytics and indexes, supported by advanced technology, set standards for global investors and help our clients understand risks and opportunities so they can make better decisions and unlock innovation. We serve asset managers and owners, private-market sponsors and investors, hedge funds, wealth managers, banks, insurers and corporates.
MSCI Inc. is an equal opportunity employer. It is the policy of the firm to ensure equal employment opportunity without discrimination or harassment on the basis of race, color, religion, creed, age, sex, gender, gender identity, sexual orientation, national origin, citizenship, disability, marital and civil partnership/union status, pregnancy (including unlawful discrimination on the basis of a legally protected parental leave), veteran status, or any other characteristic protected by law. MSCI is also committed to working with and providing reasonable accommodations to individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation for any part of the application process, please email Disability.Assistance@msci.com and indicate the specifics of the assistance needed. Please note, this e-mail is intended only for individuals who are requesting a reasonable workplace accommodation; it is not intended for other inquiries.
To all recruitment agencies
MSCI does not accept unsolicited CVs/Resumes. Please do not forward CVs/Resumes to any MSCI employee, location, or website. MSCI is not responsible for any fees related to unsolicited CVs/Resumes.
Note on recruitment scams
We are aware of recruitment scams where fraudsters impersonating MSCI personnel may try and elicit personal information from job seekers. Read our full note on careers.msci.com
Data and Operations
Providing high-quality data at scale, that fuels our indexes, analytics, research and client solutions.

