Sr. Data Engineer

Ampcus - McLean, VA

Full-time - Mid Level

McLean, VA

Professional, Scientific, and Technical Services

About the position

The Sr. Data Engineer at Ampcus Inc. is responsible for developing and maintaining data pipelines and applications using various technologies. This role requires collaboration with other engineers and adherence to Agile methodologies, focusing on data warehousing, ETL processes, and data streaming platforms.

Responsibilities

• Develop and maintain data pipelines using Python and SQL.
• Collaborate with other engineers in an Agile environment.
• Implement data warehousing solutions and ETL processes.
• Work with data streaming platforms such as Kafka.
• Utilize AWS services including EMR and Lambda for data processing.

Requirements

• 5+ years of experience in application development including Python and SQL.
• 2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud).
• 3+ years' experience with Spark and distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, or MySQL).
• 2+ years of experience with Airflow.

Nice-to-haves

• Experience with Scala and Snowflake.
• Experience related to data warehousing, ETL, and data streaming applications.
• 2+ years of experience working on real-time data and streaming applications.
• 2+ years of experience with NoSQL implementation (Mongo, Cassandra).
• 3+ years of experience with UNIX/Linux including basic commands and shell scripting.
• 2+ years of experience with Agile engineering practices.