AWS Data Engineer (10737-1) San Francisco, CA
esrhealthcare San Francisco
AWS Data Engineer, Python, Spark, AWS Services, ETL, Glue, EMR, S3, Redshift, Airflow, Data Quality, CI/CD
If you post this job on a job board, please do not use company name or salary.Experience level: Mid-senior Experience required: 7 Years Education level: Bachelors degree Job function: Information Technology Industry: Information Technology and Services Pay rate : View hourly payrate Total position: 1 Relocation assistance: No Visa sponsorship eligibility: No
Job Description:
7+ years of experience in Amazon Web Services (AWS) Cloud ComputingStrong background in designing, developing, and maintaining scalable data pipelines for ingestion and processing using Python, Spark, and AWS services
Key Skills & Expertise
ETL Development: Implement and manage ETL processes using AWS Glue and EMR for both batch and streaming dataData Storage Solutions: Design and maintain storage solutions using Medallion Architecture in S3 and Redshift
Workflow Orchestration: Monitor and optimize data workflows using Airflow or other orchestration tools
Data Quality: Ensure accuracy, consistency, and integrity throughout the data lifecycle
CI/CD: Implement and understand CI/CD practices for automated data pipeline deployment
System Monitoring: Utilize CloudWatch and Datadog for performance monitoring and reliability
Collaboration: Work closely with cross-functional teams to gather requirements and deliver business-driven data solutions
Communication: Strong ability to communicate project updates and technical details to stakeholders.
Additional Notes:
Please submit the candidate's resume in PDF format.Please remove the candidate's LinkedIn URL from the resume; otherwise, the profile will not be considered.
Please note that TCS does not consider former full-time employees (FTEs) for rehire. Additionally, individuals who have previously worked at TCS as contractors must observe a minimum waiting period of six months before being eligible for re-engagement.
Disability SolutionsDublin (CA), 27 mi from San Francisco
We are seeking a Principal Data & Advanced Analytics Engineer to help us unlock the next frontier of insight-driven decision making. The ideal candidate combines a passion for solving business problems with data, a deep understanding of Sales...
ArtechSan Francisco
Data Engineer II
Department: Product Analytics & Data Science Job
Category: Engineering / Infrastructure
Duties: The Business Intelligence (BI) team is looking to hire a Data Engineer to build robust, extensible, and scalable data and BI...
InfraStaffSan Francisco
Data Engineer with advanced Python skills and NumPy. Someone who can use Python scripts to pull data from Hive tables and has the ability to do analysis.
The consultant will Develop and maintain custom, complex ETL pipelines written in Python, some...