Senior Data Engineer (Informatica & PySpark)
Incedo Inc Pittsburgh
Senior Data Engineer (Informatica & PySpark)
Position Title: Senior Data EngineerLocation: Cleveland, OH or Pittsburgh, PA (3 days onsite)
Job Duties:-- Experience: 8 10 years in Data Engineering and Data Analysis.
- Informatica Expertise: Strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization.
- PySpark Development: Advanced skills in PySpark for large-scale data processing, transformation, and analytics.
- Hadoop Ecosystem: Solid working knowledge of Hadoop technologies (HDFS, Hive, Sqoop, MapReduce).
- Programming Skills: Proficiency in Python and Kafka for streaming and batch data pipelines.
- Database & Modeling: Strong understanding of database concepts, data design, data modeling, and ETL workflows.
- ETL Lifecycle: Experience in analyzing, designing, and coding ETL programs including data extraction, ingestion, quality checks, normalization, and loading.
- Agile Delivery: Hands-on experience with Agile methodology and Jira for project delivery.
- Client Interaction: Proven ability in client-facing roles with strong communication and leadership skills to coordinate across SDLC.
- Preferred Skills:
- Exposure to AWS data components and analytics.
- Familiarity with machine learning models and AI concepts.
- Experience with data modeling tools such as Erwin.
- Master s or Bachelor s degree in Computer Science or related field.
- Strong problem-solving skills and ability to work in cross-functional teams.
Kforce Technology StaffingPittsburgh
RESPONSIBILITIES: Kforce has a client seeking a Data Engineer on a contract basis in Pittsburgh, PA.
Summary:
The Data Engineer will be tasked with translating data requirements into applications, as well as needing to analyze, define, develop...
BrooksourcePittsburgh
closely with our ML Engineer, MLOps Engineer, Data Engineer, and infrastructure teams to ensure our data scientists have the robust data and technical environment needed to innovate and deliver impactful solutions.
Key Responsibilities:
• Technical...
Carnegie Mellon UniversityPittsburgh
collaborates with application developers, cloud and infrastructure engineers, storage, and network teams to ensure reliable, performant, secure, and cost-effective data platforms.
Your core responsibilities will include:
• Install, configure, and maintain...