
Data Engineer - Web Scraping, Market Intelligence
at Point72
Posted an hour ago
0 clicks
- Compensation
- Not specified
- City
- Warsaw
- Country
- Poland
Currency: Not specified
The Data Engineer focused on Web Scraping at Point72 will build scalable solutions for processing large, unstructured data sets by extracting data from websites using compliance-approved web crawling tools. The role involves creating tools and workflows, ensuring data quality and accuracy, and scaling scrapes while adhering to compliance standards.
A Career with Point72’s Market Intelligence Team
Point72’s Market Intelligence team is responsible for developing proprietary research products, providing data and research management services for investment teams, to support their pursuit of superior, risk-adjusted returns. We leverage innovative alternative data sources, advanced data analytics and technologies, as well as deep fundamental research to create high-quality compliant and differentiated research. Backed by the full resources of Point72, our sector-aligned teams collaborate to solve important research problems in partnership with the Firm’s investment and compliance professionals.
What you’ll do
As a Data Engineer focused on Web Scraping, you will be building solutions for processing big and unstructured data sets at Point72. You will be responsible for extracting and ingesting data from websites, using compliance-approved web crawling tools. In this role you will:
• Own the creation process of these tools, services, and workflows to improve crawl/scrape analysis, reports and data management
• Be responsible for testing the data and the scrape to ensure accuracy, quality, and compliance
• Own the process to identify and rectify any issues with breaks as well as scale scrapes as needed
What’s required
Solid Python and SQL knowledge
• Experience in running automated programs at scale
• Working experience with cloud-based technologies
• Familiarity with Linux/UNIX, HTTP, HTML, JavaScript and Networking,
• Familiarity with common techniques and tools for crawling, extracting and processing data (e.g., Requests BeautifulSoup, Scrapy, Pandas, Selenium, Spark, etc.)
• Working knowledge of version control systems and open source practices
• Great analytical and problem-solving skills
• Great communication skills (written and spoken in English)
• Bachelor's Degree in Computer Science or a related field or the equivalent demonstrated experience
• Experience with extracting text from PDFs, images, applications, etc. is a plus
• Experience with system monitoring / administration tools is a plus
• Experience with working with applications designed to display archived web content is a plus
• Commitment to the highest ethical standards
• Prior experience with analyzing big data sets
We take care of our people
- Solid Python and SQL knowledge
- Experience in running automated programs at scale
- Working experience with cloud-based technologies
- Familiarity with Linux/UNIX, HTTP, HTML, JavaScript and Networking,
- Familiarity with common techniques and tools for crawling, extracting and processing data (e.g., Requests BeautifulSoup, Scrapy, Pandas, Selenium, Spark, etc.)
- Working knowledge of version control systems and open source practices
- Great analytical and problem-solving skills
- Great communication skills (written and spoken in English)
- Bachelor's Degree in Computer Science or a related field or the equivalent demonstrated experience
- Experience with extracting text from PDFs, images, applications, etc. is a plus
- Experience with system monitoring / administration tools is a plus
- Experience with working with applications designed to display archived web content is a plus
- Commitment to the highest ethical standards
- Prior experience with analyzing big data sets
About Point72
Point72 Asset Management is a global firm led by Steven Cohen that invests in multiple asset classes and strategies worldwide. Resting on more than a quarter-century of investing experience, we seek to be the industry’s premier asset manager through delivering superior risk-adjusted returns, adhering to the highest ethical standards, and offering the greatest opportunities to the industry’s brightest talent. We’re inventing the future of finance by revolutionizing how we develop our people and how we use data to shape our thinking. For more information, visit www.Point72.com/working-here
