
Senior Data Engineer
at Millennium
Posted 12 days ago
No clicks
- Compensation
- Not specified
- City
- Not specified
- Country
- Not specified
Currency: Not specified
The Fixed Income & Commodities Data team is seeking a Senior Data Engineer with 8+ years of experience to lead the acquisition, accessibility, normalization, and cataloging of large data sets. You will design and maintain optimal data pipeline architectures and perform ETL using Python and SQL. You will provide users access to datasets through REST and Python APIs and collaborate with business users and technology stakeholders. The role requires strong Python and SQL skills, Unix/Linux experience, and a solid foundation in data management in a financial context.
The Fixed Income & Commodities Data team is looking for a Data Engineer (8+ years of experience) who will work on the acquisition, accessibility, normalizing, and cataloging of large sets of data.
Responsibilities:
Create and maintain optimal data pipeline architecture.
Extract, transform, and load data from a wide variety of data sources using Python and SQL.
Provide users access to datasets using REST and Python APIs.
Categorize, catalog, cleanse, and normalize datasets.
Communicate effectively with business users and technology stakeholders.
Required skills/experience:
8+ years of relevant experience in data engineering or a closely related field.
Strong Python skills and experience with data analysis libraries (Pandas, NumPy, SciPy).
Hands-on relational SQL database development experience.
Unix/Linux experience.
Bachelor’s degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
Desirable skills/experience:
Object-oriented languages: Java, C++, etc.
AWS cloud services: EC2, RDS, Athena, Lambda, etc.
RDBMS: SQL Server and PostgreSQL.
Identity and Access Management: Kerberos, OAuth 2.0, LDAP.
Other technologies: Apache HTTP Server, Kafka, Snowflake.
Broad understanding of credit, fixed income, derivatives, futures, FX, or other financial instruments.
Other Qualifications:
Excellent listening and communication skills (both oral and written).
Self-starter and critical thinker; takes ownership of projects and suggests improvements to the broader infrastructure.
Proactive, assertive, and attentive to detail.
Able to work both independently and collaboratively.
Comfortable handling multiple projects with competing priorities in a fast-paced environment.
Strong self-management and problem-solving skills.
Quick learner.





