Senior Data Engineer

$124,000 - $187,000/Yr

IBM - Denver, CO

Part-time - Mid Level

Denver, CO

Computer and Electronic Product Manufacturing

About the position

The Senior Data Engineer role at IBM Consulting involves working onsite in Colorado Springs, Colorado, three days a week, and requires a DoD Secret clearance. The position focuses on assembling complex data sets, improving internal processes, and building infrastructure for data extraction and transformation. The role also includes developing dashboards for data analytics and implementing AI/ML solutions, all while utilizing Agile methodologies.

Responsibilities

• Assemble large, complex sets of data that meet non-functional and functional requirements.
• Identify, design, and implement internal process improvements including re-designing infrastructure for greater scalability.
• Optimize data delivery and automate manual processes.
• Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources.
• Curate and maintain data stored in support of metrics and evaluation.
• Collaborate with developers to ensure key data points are stored in a Postgres database.
• Work with data providers and back-end API developers to normalize schemas and define data flows for persistence and analytics.
• Design, build, test, maintain, and automate data collection/pipelines.
• Develop dashboards for data analytics.
• Implement Artificial Intelligence/Machine Learning solutions.
• Use Agile methodologies to develop software.

Requirements

• Minimum three (3) years of relevant experience as a Data Engineer/Scientist.
• Experience developing data pipelines and normalizing data.
• Experience using AWS cloud services.
• Experience with PostgreSQL database.
• Ability to work efficiently on small, distributed teams.
• Familiarity with Agile principles.
• DoD Secret clearance required.

Nice-to-haves

• Experience developing Tableau Dashboards.
• ELK Stack Experience.
• Real-time event streaming.
• Experience with AWS S3, EC2, Lambda, Kinesis.
• Experience with Apache Spark, NiFi.
• Experience with Confluent Kafka.
• Experience with Containers (Docker, Docker Compose).
• DevSecOps utilizing test-driven development.
• Gitlab experience.
• A Top Secret (TS) security clearance (with SCI and SAP eligibility).
• Relevant DoD and/or Industry work experience in Space Systems Command.
• Experience with Cyber Operations.

Benefits

• Healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well-being.
• Financial programs such as 401(k), cash balance pension plan, IBM Employee Stock Purchase Plan, life insurance, and disability coverage.
• Generous paid time off including 12 holidays, sick time, vacation, and parental bonding leave.
• Training and educational resources on a personalized, AI-driven learning platform.
• Diverse and inclusive employee resource groups, giving & volunteer opportunities, and discounts on retail products.