Senior Data Engineer
Susquehanna International Group, LLP Philadelphia
Overview
We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into business-ready datasets.We are looking for an experienced data engineer who is passionate about modern data architectures, distributed data processing, and scalable analytics platforms.
In this role, you will:
- Design, develop, and support scalable data pipelines and data products for middle- and back-office systems
- Architect and implement modern data platform solutions
- Build and optimize large-scale batch and streaming data processing workflows
- Collaborate with application teams to model, transform, and deliver data solutions that meet business requirements
- Monitor, troubleshoot, and optimize data processing environments to ensure reliability, scalability, and performance
- 5+ years of experience in data engineering, data platforms, or large-scale distributed data processing
- Strong experience with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka
- Strong Python development skills required
- Experience designing and optimizing high-volume data pipelines and data processing frameworks
- Experience with query optimization and performance tuning in large-scale analytical environments
- Experience with on-premises data platforms preferred
- Industry experience within capital markets or financial services is required
- Domain knowledge particularly Operations and/or Compliance, is highly preferred
- Ability and flexibility to provide occasional off-hours/weekend support
#LI-RH1
Par Technology CorporationPhiladelphia
are seeking a Senior Data Engineer to join our team and help us build the next generation of data tools for our retail and commerce loyalty platform. The ideal candidate will have a passion for tackling complex challenges related to extracting insights from...
ArmadaPhiladelphia
SUMMARY
As a Data Engineer for our Digital Services division, you will drive the evolution of our next generation data infrastructure, which powers a wide range of analytics and software products. You will be responsible for designing, developing...
CapTech VenturesPhiladelphia
and government agencies, a list that spans across the country.
Job Description
CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We...