
Senior Data Engineer
Location: Redmond, WA | Hybrid, 3 Days Onsite per Week
TalentReach is hiring on behalf of a data technology company seeking an experienced Senior Data Engineer to develop, optimize, and maintain the infrastructure supporting large-scale data products and customer-facing APIs.
This is a hands-on engineering role focused on data pipeline development, data quality, identity resolution, and privacy compliance. The ideal candidate brings strong Python and SQL expertise, experience managing production data systems, and the ability to independently solve complex technical challenges.
Summary
The Senior Data Engineer will own data pipelines from ingestion through processing, transformation, and delivery to customer-facing applications.
You'll work with large volumes of third-party B2B and B2C data, ensuring accuracy, consistency, performance, and reliability throughout the data lifecycle. A key focus will be improving data matching, proactively identifying quality issues, and implementing reliable privacy safeguards.
This position requires someone who can work independently, troubleshoot production systems, and contribute to infrastructure improvements without relying on fully defined requirements.
What You'll Do
-
Design, build, and maintain scalable data pipelines supporting customer-facing data products and APIs
-
Own data workflows from third-party ingestion through processing, transformation, storage, and delivery
-
Develop and optimize data processing applications using Python and SQL
-
Work with modern data lakehouse technologies, including Apache Iceberg and cloud-based object storage
-
Build and maintain workflow orchestration using Dagster or similar platforms
-
Monitor incoming data feeds for accuracy, completeness, consistency, and unexpected changes
-
Identify issues such as schema changes, declining field coverage, inconsistent identifiers, and changes in source data quality
-
Develop automated data quality checks to detect problems before they impact customers
-
Improve data matching, deduplication, and record linkage across multiple sources
-
Develop processes that improve the accuracy and completeness of consumer and business identity data
-
Investigate and resolve data inconsistencies, pipeline failures, and performance bottlenecks
-
Optimize SQL queries and data processing workflows for performance and scalability
-
Work with distributed SQL engines and analytical databases supporting large-scale data operations
-
Build and maintain data privacy safeguards, including opt-out processing, suppression rules, and consent management
-
Ensure privacy-related processing requirements are consistently enforced across production workflows
-
Contribute to upgrades and modernization of core data infrastructure
-
Monitor production systems, troubleshoot incidents, and implement improvements to reliability and performance
-
Collaborate with engineering and business stakeholders to understand customer requirements and identify opportunities to improve data products
-
Recommend improvements to data models, pipelines, and processing methods based on customer needs and system performance
-
Take ownership of technical challenges from investigation through implementation and production support
What You'll Bring
Required Qualifications
-
4-8 years of professional experience in data engineering or a closely related engineering role
-
Significant hands-on experience building, deploying, and maintaining production data pipelines
-
Strong Python development skills
-
Advanced SQL skills, including query optimization, performance tuning, and troubleshooting
-
Experience working with large-scale data processing and transformation workflows
-
Experience with modern data table formats such as Apache Iceberg, Delta Lake, or Apache Hudi
-
Experience with data orchestration tools such as Dagster, Apache Airflow, Prefect, or similar platforms
-
Experience developing and maintaining reliable data ingestion and ETL/ELT processes
-
Strong understanding of data quality, validation, consistency, and reliability
-
Experience monitoring, debugging, and supporting data systems in production
-
Ability to identify and resolve performance issues across data pipelines and queries
-
Strong troubleshooting and problem-solving skills
-
High attention to detail, particularly when working with data accuracy, privacy, and compliance requirements
-
Ability to independently manage technical projects and make decisions with incomplete requirements
-
Comfortable working across different technologies and contributing beyond a narrowly defined engineering specialty
-
Strong communication and collaboration skills
-
Ability to work onsite in Redmond, Washington, three days per week
Preferred Qualifications
-
Experience with identity resolution, entity matching, record linkage, fuzzy matching, or probabilistic deduplication
-
Experience working with large-scale B2B or B2C datasets
-
Experience with Rust, including Python integrations using PyO3
-
Familiarity with real-time analytical databases such as ClickHouse, StarRocks, or Apache Druid
-
Experience with Polars, DuckDB, or Apache DataFusion
-
Experience with Apache Iceberg and Amazon S3
-
Experience building or supporting distributed SQL processing environments
-
Familiarity with data privacy regulations such as CCPA, CPRA, GDPR, or state-level opt-out requirements
-
Experience implementing data suppression, consent management, or privacy-related processing controls
-
Background in data technology, marketing technology, advertising technology, or related industries
-
Experience with AWS infrastructure and cloud-based data platforms
-
Experience contributing to data infrastructure modernization initiatives
TalentReach is committed to creating an inclusive workplace where everyone has the opportunity to succeed. We celebrate diversity and are proud to be an equal opportunity employer. Employment decisions are made without regard to race, color, religion, sex, gender identity or expression, sexual orientation, national origin, age, disability, veteran status, or any other legally protected status.