Data Engineer - FIC Technology
at Millennium
Posted 4 hours ago
No clicks
- Compensation
- $175,000 – $250,000 USD
- City
- New York City
- Country
- United States
Currency: $ (USD)
The Data Engineer will build and maintain data pipelines, normalize and catalog large datasets, and provide programmatic access via REST and Python APIs for the Fixed Income & Commodities Data team. The role involves ETL using Python and SQL, data cleansing and cataloging, and collaboration with business users and technology stakeholders.
The Fixed Income & Commodities Data team is looking for a Data Engineer that will work on the acquisition, accessibility, normalizing, and cataloging of large sets of data.
Responsibilities:
- Create and maintain optimal data pipeline architecture
- Extraction, transformation, and loading of data from a wide variety of data sources using Python and SQL
- Providing users access to datasets using REST and Python APIs
- Categorizing, cataloging, cleansing and normalizing of datasets
- Communicating with business users and technology stakeholders.
Required skills/experience:
- Bachelor’s degree in Computer Science or a related field
- 5+ years of professional experience with python data engineering
- Python and data analysis libraries (Pandas, NumPy, SciPy)
- Relational SQL database development
- Unix/Linux command-line experience
Desirable skills/experience:
- Object-oriented languages: Java, C++, etc.
- AWS cloud services: EC2, RDS, Athena, Lambda, etc.
- RDBMS: SQL Server and PostgreSQL
- Identity and Access Management: Kerberos, OAuth 2.0, LDAP
- Other: Apache HTTP Server, Kafka, Snowflake
- Broad understanding of fixed income, derivatives, futures, FX, or other financial-services instruments
Other Qualifications:
- Excellent listening, and communication (both oral and written) skills.
- Self-starter and critical thinker, takes ownership of own projects and makes improvement suggestions for the entire infrastructure.
- Proactive, assertive and attentive to details working independently and in a collaborative environment.
- Ability to handle several projects with different priorities at the same time in a fast-paced environment.
- Excellent self-management and problem-solving skills and a quick learner
The estimated base salary range for this position is $175,000 to $250,000, which is specific to New York and may change in the future. Millennium pays a total compensation package which includes a base salary, discretionary performance bonus, and a comprehensive benefits package. When finalizing an offer, we take into consideration an individual’s experience level and the qualifications they bring to the role to formulate a competitive total compensation package.
