Senior Software Engineer, Data Platform

Hiring for multiple roles. Traditional forecasting breaks under petabytes of features, megabytes of labels, and time-varying noise. Our breakthrough research is foundational in the field: generating industry-beating results ( MIT News ). Our predictive engines combine a wide variety of data through rigorous scientific process. We leverage alternative datasets (consumer transactions, geolocation, etc) along with private, public, external, and internal data. The Data Platform is a critical component in our scientific approach to forecasting. The role will require everything from high-level architecture design to performant implementation. Responsibilities include: Build distributed systems supporting complex transformations over petabyte-scale data Design, implement, and maintain production cloud data pipelines for complex, disparate datasets Work closely with our Quants and Applied Scientists to support rigorous scientific process, rapid experimentation, and new product initiatives Required qualifications: Bachelor’s or advanced degree in Computer Science, math or equivalent 3+ years of experience in data engineering or related fields with a track record of building (coding) and scaling a data platform 2+ years of industry experience building ETL pipelines in a major cloud provider Highly proficient in python and SQL Advanced knowledge of databases, design patterns, OOP, and concurrency Knowledge of data management fundamentals and data storage principles Passion for intuitive data models Experience communicating with senior management as well as colleagues from engineering, analytics, and business backgrounds Experience with AWS, orchestration platforms, and modern tech stacks Strong software engineering fundamentals: system design, algorithms, data structures Nice-to-haves: Experience building systems that integrate LLMs with large-scale data processing Working understanding of basic probability and statistics Experience implementing ML models Experience with DBT MS or PhD in STEM field In-person at our NYC office strongly preferred. Remote candidates who can spend some time in-office (e.g., monthly) will also be considered. Benefits: The salary range for this position is $145,000-$220,000 Free health, vision, dental insurance 401k with match Unlimited PTO + 13 company holidays Daily Grubhub lunch stipend Pre-tax commuter benefits