Data Engineer - FIC Technology
at Millennium
Posted a day ago
No clicks
- Compensation
- $175,000 – $250,000 USD
- City
- New York City
- Country
- United States
Currency: $ (USD)
Join the Fixed Income & Commodities Data team to build and maintain pipelines for acquisition, normalization, cataloging, and accessibility of large datasets. You will design and operate ETL processes using Python and SQL, provide dataset access via REST and Python APIs, and perform data cleansing and cataloging. The role requires collaboration with business users and technology stakeholders and working with Unix/Linux and relational databases in a fast-paced finance environment.
The Fixed Income & Commodities Data team is looking for a Data Engineer that will work on the acquisition, accessibility, normalizing, and cataloging of large sets of data.
Responsibilities:
- Create and maintain optimal data pipeline architecture
- Extraction, transformation, and loading of data from a wide variety of data sources using Python and SQL
- Providing users access to datasets using REST and Python APIs
- Categorizing, cataloging, cleansing and normalizing of datasets
- Communicating with business users and technology stakeholders.
Required skills/experience:
- Bachelor’s degree in Computer Science or a related field
- 5+ years of professional experience with python data engineering
- Python and data analysis libraries (Pandas, NumPy, SciPy)
- Relational SQL database development
- Unix/Linux command-line experience
Desirable skills/experience:
- Object-oriented languages: Java, C++, etc.
- AWS cloud services: EC2, RDS, Athena, Lambda, etc.
- RDBMS: SQL Server and PostgreSQL
- Identity and Access Management: Kerberos, OAuth 2.0, LDAP
- Other: Apache HTTP Server, Kafka, Snowflake
- Broad understanding of fixed income, derivatives, futures, FX, or other financial-services instruments
Other Qualifications:
- Excellent listening, and communication (both oral and written) skills.
- Self-starter and critical thinker, takes ownership of own projects and makes improvement suggestions for the entire infrastructure.
- Proactive, assertive and attentive to details working independently and in a collaborative environment.
- Ability to handle several projects with different priorities at the same time in a fast-paced environment.
- Excellent self-management and problem-solving skills and a quick learner
The estimated base salary range for this position is $175,000 to $250,000, which is specific to New York and may change in the future. Millennium pays a total compensation package which includes a base salary, discretionary performance bonus, and a comprehensive benefits package. When finalizing an offer, we take into consideration an individual’s experience level and the qualifications they bring to the role to formulate a competitive total compensation package.
