The Mission: Powering the Future of Esports Intelligence
At
Oddin.gg, data isn’t just a byproduct—it’s our core product. We provide the data-driven backbone for esports betting, widgets, and trading. We are looking for a
Data Engineer to take the reins of our data landscape.
Currently, we have 15 brilliant Data Scientists building models. However, they are spending too much time "fighting the data" rather than "modeling the data." You will be the architect who changes that. You will own the transition from fragmented, script-based pipelines to a unified, high-availability data platform that ensures our CS2, Dota 2, and LoL data is 100% reliable and "Model-Ready."
The Challenges You’ll Solve
Pipeline Orchestration: Move us away from fragmented ownership towards a centralized workflow ( replacing legacy orchestration where needed.
Data Quality as a Standard: The raw historical data acquisition pipeline does not currently cover the full breadth of professional matches required. Your goal is to improve coverage and reliability by building monitoring and alerting that detects data gaps or failures before they impact downstream consumers.
Infrastructure Evolution: Refactor our "Data Lake" (S3/Athena), help us to move to ClickHouse and optimize our AWS footprint for both performance and cost (FinOps).
What You’ll Do
Own the Lifecycle: Take complete ownership of ETL processes from ingestion (scraping/APIs) to the "Model-Ready" layer.
Architect Resilience: Redesign our data flows to handle different use cases (Real-time Widgets vs. Long-term Training Data) within a single, scalable architecture.
Collaborate with Data Scientists: Act as the bridge between raw data and the Model-Ready datasets used by our Data Science teams.
Refactor & Modernize: Implement strict type-hinting, and improve CI/CD testing standards across our data repos.
Your Technical Arsenal
Python Mastery: 3+ years of professional experience. We don’t just write scripts; we build software. You should be comfortable with Pydantic, Type Hinting, and testing.
AWS Cloud Native: Experience with S3, Lambda, Step Functions, and DynamoDB. You know how to build serverless workflows that scale.
SQL & Data Modeling: Good SQL skills. You understand how to structure data for both transactional integrity and analytical performance.
Data Observability: Experience setting up monitoring for data pipelines (e.g., Prometheus, Grafana, or custom metadata-driven alerts).
Scraping Experience (Bonus): Familiarity with web scraping frameworks and navigating anti-bot measures (Cloudflare/Proxies) is a massive plus.
Direct Impact: Your work directly influences the ROI of 15 Data Scientists and the reliability of our flagship trading products.
Complex Domain: You’ll be working with unique data structures (game demofiles, HDF files, and real-time event streams) that you won't find in standard FinTech or E-commerce.
Professional Growth: You aren't just maintaining; you are building a Data Engineering department from the ground up within the BI team.
The Culture: We are gamers and tech enthusiasts. If you follow the CS2 or Dota 2 pro scenes, you’ll be in your element.
Our Current Tech Stack
Languages: Python (Primary).
Data: PostgreSQL, S3, Athena, Parquet, HDF5.
Infra: AWS (Lambda, Step Functions, DynamoDB).
Tools: dbt, Streamlit, GitHub Actions.
