Data Engineer

E-Solutions Group - Arlington, VA

Full-time

Arlington, VA

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

The Data Engineer role involves designing and creating data ingestion pipelines to extract data from various sources such as Kafka and Snowflake. The position requires proficiency in several tools and technologies, including Airflow, Nifi, SQL, and AWS S3, and is structured as a hybrid role based in Arlington, VA.

Responsibilities

• Design and create data ingestion pipelines.
• Create data extracts from Kafka and Snowflake.
• Utilize tools such as Airflow, Nifi, SQL, and AWS S3.

Requirements

• Experience with SQL and Snowflake, including hands-on experience writing queries.
• Proficiency in tools like Apache Nifi, Airflow, and AWS S3.
• Experience in scripting using shell scripts and Python.

Nice-to-haves

• Knowledge about data ingestion from Kafka.
• Familiarity with other Amazon services like Lambda.