Our Client is one of the United States’ largest insurers, providing a wide range of insurance and financial services products with gross written premiums well over US$25 Billion (P&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and independent agents and nearly 18,500 employees. Finally, our Client is part of one the largest Insurance Groups in the world.
Position Overview
We are seeking a skilled and self-driven AWS Data Engineer to design, develop, and maintain scalable data ingestion frameworks that support enterprise analytics and reporting. The ideal candidate will have deep expertise in AWS technologies, data lake architecture, and cross-functional collaboration to deliver high-quality data solutions.
Key Responsibilities
Data Ingestion & Framework Development
- Design, build, and maintain reusable, modular, and configuration-driven frameworks for ingesting both historical and incremental data from diverse sources into Iceberg tables on AWS S3.
- Expose ingested data to Snowflake via Snowflake external tables, ensuring seamless integration and accessibility.
- Implement robust logging mechanisms to monitor all data processes, ensuring completeness, timeliness, accuracy, and validity (ABC metrics).
- Configure automated notifications to alert support teams of process statuses and anomalies.
- Adhere to architectural standards and development best practices throughout the lifecycle.
Solution Design & Execution
- Translate complex business requirements into scalable and efficient technical solutions.
- Independently plan and execute the implementation of new data capabilities, including:
- Development of project plans with clear milestones and delivery timelines.
- Task breakdown, assignment, and management.
- Comprehensive documentation and tracking of work using Rally or equivalent tools.
- Identification and management of dependencies across cross-functional teams.
Cross-Team Collaboration
- Coordinate effectively with internal and external stakeholders, including:
- Cloud Operations
- Information Security
- Business Units
- Other Development Teams
- Facilitate alignment and secure commitment from partner teams to meet project deliverables and dependency timelines.
Proactive, Timely, Concise and Audience Appropriate Communication
- Communicates complex technical concepts to technical and non-technical personnel.
- Delivers routine progress and status to stakeholders.
- Communicates information in line with the target audience experience, background, and expectations; uses terms, examples, and analogies that are meaningful to the audience.
- Ensures accuracy of information communicated to effectively support project leadership decision making.
Continuous Improvement
- Proactively accumulates and maintains knowledge of current and emerging/evolving technologies, concepts, and trends in the IT field.
- Provides input on improving or enhancing existing organizational processes based on lessons learned and experiences from project work.
- Performs root cause analysis to quickly identify and resolve issues causing recurring technical problems.
Self-Driven Problem Solving & Initiative
- Demonstrates a high degree of independence and ownership in driving initiatives from concept to completion.
- Proactively identifies challenges and inefficiencies, and takes swift action to resolve them without waiting for direction.
- Navigates complex organizational structures to engage the right stakeholders and ensure timely delivery.
- Maintains a solution-oriented mindset, continuously seeking opportunities to improve processes, enhance collaboration, and deliver value.
