Data Engineer

$166,400 - $166,400/Yr

Spectraforce Technologies - North Chicago, IL

Full-time - Mid Level

North Chicago, IL

Administrative and Support Services

About the position

The Data Engineer role at SPECTRAFORCE involves partnering with various teams to define and execute data acquisition, storage, transformation, and processing. The position is crucial for making data actionable for operational and analytics initiatives, ultimately driving sustainable revenue and growth. The role requires expertise in data sources and technology, as well as a working knowledge of data transformation and analytical tools, particularly within a cloud-based data lake architecture.

Responsibilities

• Support large scale data pipelines in a distributed and scalable environment
• Enable and optimize production AWS environment for data infrastructure and frameworks
• Create Terraform modules to automate deployments
• Utilize Databricks and Datalake technologies
• Partner with development teams and stakeholders to provide technical solutions
• Lead design and development of batch and streaming data applications using AWS technologies
• Provide technical direction and guidance to the team
• Coordinate and guide cross-functional projects
• Manage agile development and delivery in collaboration with project managers and product owners

Requirements

• Bachelor's degree in a quantitative field (statistics, software engineering, business analytics, etc.)
• 5+ years of experience in data engineering or ETL development
• Experience performing root cause analysis on data and processes
• Strong analytic skills with structured, semi-structured, and unstructured datasets
• Experience with Big Query, SQL server, and AWS cloud services (Redshift, S3, Athena)
• Proficiency in SQL and various database interface tools (SSMS, Oracle SQL developer)
• Strong initiative to take ownership of data-focused projects
• Ability to communicate complex quantitative concepts clearly
• Proven proficiency with Microsoft Excel and PowerPoint
• Strong problem-solving skills

Nice-to-haves

• Master's degree
• Experience with Quantum Metrics and Akamai
• Experience with languages: Python, R
• Strong experience with continuous integration & delivery using Agile methodologies
• Data engineering experience in the transportation/airline industry

Benefits

• ACA compliant health benefits
• Dental insurance
• Vision insurance
• Accident insurance
• Critical illness insurance
• Voluntary life insurance
• Hospital indemnity insurance
• Commuter benefits
• 401K plan with matching
• Referral bonus program
• Paid sick leave when required by law