Data Engineer
We are seeking an experienced Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. The ideal candidate has professional experience building ETL pipelines using Python and has an in-depth familiarity with databricks and snowflake.
The chosen professional will work closely with our team to streamline and scale our data operations.
Responsibilities:
1. Design, develop, construct, install, test and maintain highly scalable data management systems.
2. Engage continuously with decision-makers and users to understand and establish business and technical needs.
3. Develop and implement scripts for database maintenance, performance tuning, and system monitoring.
4. Design and create robust data pipelines, architectures and data sets, and automated ETL processes.
5. Ensure all systems meet business plans and industry standards for security and privacy.
6. Interact with the full spectrum of database and business intelligence tools; Ranging from data ingestion to consumption for end-users.
7. Transform complex analytical models into scalable data-driven apps.
8. Understand how to apply technologies to solve big data problems and develop innovative big data solutions.
9. Work with data and analytics experts to strive for greater functionality in our data systems.
Requirements:
1. At least 3 years experience as a Data Engineer with a focus on ETL pipelines.
2. Expert knowledge of Python, SQL, Databricks, and Snowflake.
3. Knowledge of big data architectures and data warehousing principles and practices.
4. Experience with schema design and data modeling.
5. Proficiency in handling and optimizing for large data sets.
6. Exceptional analytical and problem-solving abilities.
7. Demonstrable code and query optimizing skills for performance improvement.
8. Bachelor's degree in computer science or a related field, or equivalent experience.
The chosen professional will work closely with our team to streamline and scale our data operations.
Responsibilities:
1. Design, develop, construct, install, test and maintain highly scalable data management systems.
2. Engage continuously with decision-makers and users to understand and establish business and technical needs.
3. Develop and implement scripts for database maintenance, performance tuning, and system monitoring.
4. Design and create robust data pipelines, architectures and data sets, and automated ETL processes.
5. Ensure all systems meet business plans and industry standards for security and privacy.
6. Interact with the full spectrum of database and business intelligence tools; Ranging from data ingestion to consumption for end-users.
7. Transform complex analytical models into scalable data-driven apps.
8. Understand how to apply technologies to solve big data problems and develop innovative big data solutions.
9. Work with data and analytics experts to strive for greater functionality in our data systems.
Requirements:
1. At least 3 years experience as a Data Engineer with a focus on ETL pipelines.
2. Expert knowledge of Python, SQL, Databricks, and Snowflake.
3. Knowledge of big data architectures and data warehousing principles and practices.
4. Experience with schema design and data modeling.
5. Proficiency in handling and optimizing for large data sets.
6. Exceptional analytical and problem-solving abilities.
7. Demonstrable code and query optimizing skills for performance improvement.
8. Bachelor's degree in computer science or a related field, or equivalent experience.
Don’t miss out on new job openings!
Create a job alert for: Data Modeler, Houston
It's free, and you can cancel email updates at any time