ETL Data Engineer

Sanrose Information Services - Baton Rouge, LA

Full-time

Baton Rouge, LA

Professional, Scientific, and Technical Services

About the position

The ETL Data Engineer position is focused on designing, implementing, and managing data pipelines and workflows to support data processing and analysis. The role requires extensive experience in backend data engineering, particularly with ETL processes and data warehousing concepts, as well as proficiency in various programming languages and big data technologies.

Responsibilities

• Design and implement ETL processes to extract, transform, and load data from various sources.
• Manage data pipelines and workflows using Apache Airflow.
• Develop data automations within existing frameworks.
• Ensure data quality and integrity throughout the ETL process.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions.
• Implement engineering best practices such as source control, automated testing, and continuous integration.

Requirements

• Bachelor's degree in computer science, Information Technology, or a related field.
• 12+ years of experience as a Backend Data Engineer or in a similar role.
• Strong understanding of ETL processes and data warehousing concepts.
• Proven experience with Python and related data engineering libraries (e.g., pandas, NumPy, Spark).
• Hands-on experience with Apache Airflow for managing data pipelines and workflows.
• Proficiency in programming languages commonly used in data engineering, such as Python, Java, Scala, or SQL.
• Experience with big data technologies and frameworks like Hadoop, Spark, Kafka, and Flink.
• Strong understanding of database systems, including relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
• Experience with engineering best practices such as source control, automated testing, continuous integration and deployment, and peer review.

Nice-to-haves

• Experience with cloud computing platforms.
• Familiarity with agile development methodologies, software design patterns, and best practices.
• Strong analytical thinking and problem-solving abilities.
• Excellent verbal and written communication skills.
• Flexibility to adapt to evolving project requirements and priorities.
• Outstanding interpersonal and teamwork skills.
• Experience working in a virtual environment with remote partners and teams.
• Proficiency in Microsoft Office.