Senior Data Engineer

MITRE Corporation - Bedford, MA

Full-time - Mid Level

Bedford, MA

Professional, Scientific, and Technical Services

About the position

The Senior Data Engineer at MITRE will play a crucial role in designing and building data solutions that support decision-making and mission processes. This position involves working with project teams to manage and analyze data at scale, ensuring data quality, and utilizing various data engineering tools and technologies. The role is integral to the Data Environments and Engineering Department, focusing on innovative solutions to complex data challenges.

Responsibilities

• Designing and building prototypes for ingesting, curating, and analyzing data at scale.
• Collecting and preparing data for use by data scientists and analysts.
• Supporting stakeholder interviews to determine data requirements and define data flows.
• Documenting data transformation rules to meet the requirements for system interfaces and data integration projects.
• Performing data profiling to identify quality gaps and determine if data is fit for use for its intended purpose.
• Researching and evaluating data engineering tools and technologies.
• Leading or supporting sponsor work conducted in a lab environment.

Requirements

• Typically requires a minimum of 5 years of related experience with a bachelor's degree; or 3 years and a master's degree; or a PhD without experience; or equivalent combination of related education and work experience.
• Secret clearance is required.
• Strong developer skills using SQL and Python.
• Hands-on experience with one or more database technologies (e.g., PostgreSQL, Oracle, MySQL, SQL Server, DB2, MongoDB, Neo4j, Couchbase, Cassandra).
• Excellent written and verbal communications skills with ability to describe and present complex technical concepts in relatable terms.
• Strong knowledge of ETL/ELT processes, tools, and frameworks.
• Experience with large scale data architectures.
• Experience building conceptual, logical, and physical data models.
• Knowledge of cloud platforms and technologies such as Amazon Web Services, Microsoft Azure, and Google Cloud Platform.
• Proficiency in one or more modern programming languages such as Python, R, Scala, C++, Java, C#, and JavaScript.
• Expertise in preparing data for analysis.
• Strong understanding of data science concepts.
• Experience with BI tools.
• Understanding ML frameworks, algorithms, and libraries.
• Applied mathematics: probability and statistics.
• Strong innovation, problem-solving, systems analysis, planning, organizational, and interpersonal skills.
• Knowledge of data management practices that align with modern/emerging analytics techniques.
• Desire to continuously learn new techniques and evolve approaches.

Nice-to-haves

• Master's degree in computer science, data science, systems engineering, software engineering, or information systems.
• Experience migrating legacy data systems to new/modernized platforms.
• Hands-on experience with data flow and pipeline frameworks such as Kafka, NiFi, Spark, Airflow, and Hadoop.
• Familiarity with microservice architectures, data warehousing, data fabric, data lakes, and data mesh.
• Understand the use of data in AI/ML and LLM.
• Knowledge and experience across data management domains, including data science, data governance, metadata management, data quality, business intelligence, data security & privacy, and data strategy.
• Experience performing source to target data mapping.
• Knowledge of natural language processing techniques.

Benefits

• Competitive benefits
• Exceptional professional development opportunities
• Culture of innovation that embraces diversity, inclusion, flexibility, collaboration, and career growth