Senior Data Engineer - AWS Data Pipelines
Listing checked September 12, 2026 · pay as published by Talentxo
Overview
Build and maintain the data backbone for a product team serving Pharma Commercial clients. You will design ETL/ELT pipelines, model Star and Snowflake schemas, and load large datasets into AWS Redshift. The stack centers on AWS Glue, Lambda, S3, EMR, and Code Pipeline, with GitHub for version control. You will also create analytics tools that surface customer acquisition and operational efficiency insights, while keeping data private and compliant.
What You'll Do10
- 1Design and maintain optimal data pipeline architecture for ETL/ELT into structured data.
- 2Assemble large, complex datasets that meet business needs and build multi-dimensional models such as Star Schema and Snowflake Schema.
- 3Create scalable data warehouses with fact tables, dimensional tables, and ingest datasets into cloud-based tools.
- 4Identify, design, and implement internal process improvements, including automating manual processes and improving data delivery.
- 5Collaborate with stakeholders to integrate data with internal data marts and enhance advanced reporting.
- 6Set up and maintain data ingestion, streaming, scheduling, and job monitoring automation using AWS Lambda, Code Pipeline, Glue, S3, and Redshift.
- 7Build analytics tools that use the data pipeline to provide actionable insight into customer acquisition and operational efficiency.
- 8Support stakeholders with data-related technical issues and their data infrastructure needs.
- 9Use GitHub for version control, code collaboration, and repository management.
- 10Create data tools for analytics and data scientist team members, and ensure data privacy and compliance with relevant regulations.
Requirements12
- 14-8 years of relevant data engineering experience.
- 2Advanced working SQL knowledge and experience with relational databases and cloud data warehouses like AWS Redshift.
- 3Experience creating scalable, efficient schema designs to support diverse business needs.
- 4Experience with database normalization, schema evolution, and maintaining data integrity.
- 5Experience in data modeling, OLAP cube modeling, and developing data models with dimensions and facts.
- 6Experience building and optimizing big data pipelines, architectures, and datasets.
- 7Experience with ETL/ELT processes and processing large disconnected datasets.
- 8Strong analytic skills related to working with structured and unstructured datasets.
- 9Working knowledge of message queuing, stream processing, and highly scalable big data stores.
- 10Experience with AWS cloud services including S3, EC2, Lambda, Glue, EMR, and Code Pipeline.
- 11Familiarity with relational SQL and NoSQL databases.
- 12Data compression experience with PARQUET format, root cause analysis, agile working models, and a Bachelor's or Master's degree in Technology or Computer Science.
Who Should Apply
Candidates with 4-8 years of data engineering experience and deep SQL skills will fit well, especially those who have built scalable warehouses on AWS Redshift and worked with Glue, Lambda, and S3. The role suits engineers who enjoy schema design, OLAP cube modeling, and optimizing ETL/ELT pipelines for large datasets. Someone without hands-on AWS data services or PARQUET compression experience may score lower. Also, if you lack experience with message queuing or stream processing, this position may not be the best match.
Salary Insight
Open to Discussion
Pay and demand for Data Engineering roles
AggregatedTypical pay
$75/hour
This role
Pay not disclosed
Most Data Engineering roles pay $55–$95 per hour.
Based on 340 similar roles that publish pay · 53 publish only a top rate; those count at the rate they gave
Rates shown per hour. Yearly and monthly pay converted; one-time fees and non-USD pay are not included.
- Live similar roles
- 454
- Listed in last 30 days
- 258
- Remote
- 90%
Hiring most right now: micro1 (167) · Mercor (55) · Turing (50)
Most requested skills · share of roles
- python25%
- JAVA8%
- technical writing7%
- docker7%
Figures from Data Engineering roles live on NearSkill when this page loaded. A role can close before you apply, so check the listing itself.
Compare your resume against these rolesLocation
Compensation
Undisclosed by Talentxo
Confirmed during Talentxo profile screening.
Required Skills
Application Tip
Highlight specific projects where you designed Star or Snowflake schemas and used AWS Glue or Lambda to automate data pipelines. Quantify the scale of data processed and the impact on reporting or operational efficiency.
How NearSkill helps you apply
1. Check your job match
We compare your resume with the job requirements to help you understand how well your experience fits.
2. Continue to the employer’s website
We’ll direct you to the employer’s application portal, where you can complete the application.
3. Get updates by email
If NearSkill is handling follow-up for this role, we’ll email you when there’s an update on your screening.
Want to check your fit first?
See how your resume matches this role before applying.
Check my job matchSimilar open positions
Explore active roles that match your skills and interests.
Talentxo
VerifiedSenior Data Engineer (AWS, Python/Java)
The role owns the design and maintenance of scalable data pipelines and infrastructure at scale. It requires hands on work with AWS services including S3, Glue, EMR, Lambda, and Redshift to enable analytics and machine learning initiatives. The team collaborates with data scientists and analysts to understand requirements, optimize storage, ensure data governance, and monitor pipelines. The position offers exposure to emerging technologies and a chance to influence data engineering capabilities across projects.
Micro1
VerifiedData Engineer
A full-time remote role for a data engineer who can build and maintain scalable ETL pipelines and handle both structured and unstructured data. You will transform raw information into reliable datasets that support research, analytics, and AI model work, with exposure to machine learning tools viewed as valuable. You’ll collaborate with researchers, data scientists, and engineers to prep data for AI initiatives, and you’ll work with familiar tools and environments to ensure solid data quality.
Micro1
VerifiedStrategic Projects Lead for Coding Data Pipelines
As a Strategic Projects Lead, you will own the full lifecycle of coding data pipelines used to train frontier AI models. You’ll partner with AI Lab clients, software engineers, reviewers, and internal teams to ensure scalable, high-quality delivery. You will define task specs, oversee automation of workflows, and monitor pipeline health to meet timelines and quality standards. This remote, full-time role requires hands-on leadership and a focus on measurable outcomes coding and data operations throughout the project lifecycle.
AfterQuery
VerifiedData Engineering Expert
AfterQuery hires data engineers for remote contract projects that run for 2 to 3 weeks at a time. You will build and deploy data infrastructure, document pipeline architecture, and resolve failures using tools such as DBT, Kafka, Spark, Snowflake, or Redshift. The role calls for 1 to 3 years of professional experience in data engineering or ETL work. The listing notes a 40-hour commitment each week, while individual project assignments can require 10 to 20 hours per week. Pay is estimated at $60 to $100 per hour, and the work comes from an early-stage Y Combinator-backed company.
Micro1
VerifiedData Engineer
This role puts your data engineering skills to work in an exciting way: you'll help build and refine the datasets that teach next-generation AI models. No prior AI experience is needed—your deep knowledge of databases, pipelines, and data quality is what counts. You'll work remotely on a contract basis, earning a competitive hourly rate while making a tangible impact on how machines learn.
Micro1
VerifiedData Engineer
As a Data Engineer at micro1, you will build and scale the data infrastructure that powers AI-driven products and research. You will develop distributed data pipelines, manage large-scale datasets across cloud environments, and design reliable data systems that support data processing, experimentation, and model development at scale. The role involves working with Python, SQL, Spark, and AWS to create robust data solutions. You will collaborate with AI researchers, data scientists, and engineering teams to support data-intensive applications.