Data Engineer

Robert Half - Chicago, IL

Full-time - Mid Level

Chicago, IL

Administrative and Support Services

About the position

We are offering a long-term contract opportunity for a Data Engineer. This role is crucial in the development and optimization of data systems through the design and construction of ETL pipelines, data models, queries, and scripts. The Data Engineer will work closely with business domain leads, data scientists, product owners, and architects to deliver enterprise data solutions. This role is within the tech industry and focuses heavily on cloud-based infrastructure and data management. The Data Engineer will be responsible for ensuring that data systems are efficient, reliable, and scalable, which is essential for supporting the organization's data-driven decision-making processes. The position requires a strong understanding of data structures, data modeling, and software architecture, as well as the ability to communicate complex technical information to various stakeholders. The successful candidate will also participate in the design and development of cloud-based infrastructure batch ETL processes, contributing to the overall data management policies, standards, and procedures.

Responsibilities

• Develop and maintain ETL pipelines and data models to optimize system performance.
• Create and implement scripts and maintenance procedures for data management.
• Collaborate with business domain leads, data scientists, and product owners to deliver enterprise data solutions.
• Participate in the design and development of Cloud-based infrastructure batch ETL processes.
• Construct multi-dimensional databases and data marts in line with business requirements.
• Contribute to the development of data management policies, standards, and procedures.
• Identify opportunities for process improvements, including automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.
• Communicate complex technical information to project stakeholders, ensuring non-functional requirements are captured.
• Collaborate with foundational solution functional teams, vendors, and technology support teams to build and deliver solutions on business initiatives.
• Take part in the delivery of solutions through a minimum viable product (MVP) and subsequent iterative cycles of development.

Requirements

• Must hold a minimum of 5 years of experience as a Data Engineer or in a similar role
• Proficiency in Apache Kafka, Apache Spark, and Cloud Technologies is necessary
• Experience with Database and EO/IR systems is required
• Proven skills in Algorithm Implementation and Analytics
• Knowledge of Apache Hadoop and API Development is a must
• Familiarity with AWS Technologies and Azure Databricks is essential
• Must have experience in ETL - Extract Transform Load and T-SQL - Transact-SQL
• Excellent problem-solving abilities and detail orientation
• Strong communication and team management skills
• Bachelor's degree in Computer Science, Engineering, or related field is required
• Strong understanding of data structures, data modeling, and software architecture
• Ability to work in a fast-paced environment and manage multiple tasks simultaneously.

Benefits

• Medical insurance
• Vision insurance
• Dental insurance
• Life insurance
• Disability insurance
• 401(k) plan