Staff Software Engineer, Data Systems (Python)

About the Role

Northbeam is fundamentally a data product - the whole company. We don’t sell shoes, or ads, or games. We sell data: quality integrations with a variety of platforms, fresh and reliable data pulls, robust data ingest APIs, correct aggregations and algorithmic insights on top of that data, all packaged up in a user-facing application.

What this means for you is that high-quality, robust data integration is at the core of what we do, and your work will have a direct connection to the company’s success.

As a Data Engineer working at Northbeam, you will work with a cross-functional team of product managers, product engineers, and business leaders to translate our customers’ feedback into scalable data pipelines and products.

The work involves creating, maintaining, and improving a labyrinth of integrations and transformations in a complex network of touchpoints to keep everything running smoothly. The system is powered by data that spans numerous ad platforms, a variety of order management systems (such as Shopify and Amazon), as well as our own real-time events that we collect as our customers navigate their online stores.

Curiosity, experience, and a desire to build data pipelines and applications at scale will be the key to success in this role.

Your Impact

• Work with our customers, product managers, product engineers, and customer support, to scope, build, and iterate high value solutions.
• Provide technical leadership to various software engineers and drive the long term technical strategy with scalable architecture and best practices.
• Build and maintain data ingestion pathways spanning APIs, file processing, and configurable inputs.
• Own and Implement the data/infrastructure engineering aspects end-to-end from idea to solution as part of a cross functional effort with your peers.
• Work on the data pipeline architecture and optimize it for readability, maintainability, as well as cost.
• Integrate with our machine learning and data science systems to deliver insights to our customers.
• Maintain and augment the necessary infrastructure to scale our platform.
• Write technical documentation for internal and external stakeholders.

What You Bring

• Solid understanding of data processing needs of real-time and batch systems for transactional and analytical processing
• Experience with SQL / Java / Scala / Spark / Python
• Experience designing and deploying high performance systems with reliable monitoring and logging practices
• Experience with data pipeline orchestration tools and practices
• 8+ plus years of experience

Bonus Skills & Experience

• Experience in data engineering solutions such as Bigquery, Airflow, dbt, Kafka, Pinot
• Prior experience working in marketing, e-commerce, or ad-tech
• Experience working with cloud infrastructure such as Google Cloud Platform, Azure, or AWS
• Experience or a desire to leverage infrastructure-as-code