Lead Data Engineer

MITRE Corporation - Bedford, MA

Full-time - Mid Level

Bedford, MA

Professional, Scientific, and Technical Services

About the position

The Lead Data Engineer at MITRE will play a crucial role in addressing challenges related to data management and sharing, supporting decision-making processes and mission operations. This position involves leading project teams, designing data solutions, and ensuring high-quality data contributions to various projects. The role requires a strong foundation in data engineering, systems engineering, and software engineering, with a focus on innovation and collaboration within a diverse and inclusive work environment.

Responsibilities

• Leading the development of high quality, high velocity contributions to sponsor challenges and deliverables
• Designing and building prototypes for ingesting, curating, and analyzing data at scale
• Collecting and preparing data for use by data scientists and analysts
• Leading stakeholder interviews to determine data requirements and define data flows
• Documenting data transformation rules to meet the requirements for system interfaces and data integration projects
• Performing data profiling to identify quality gaps and determine if data is fit for use for its intended purpose
• Researching and evaluating data engineering tools and technologies

Requirements

• Typically 8 years of related experience with a Bachelor's degree; or 6 years and a Master's degree; or a PhD with 3 years experience; or equivalent combination of related education and work
• Capable of obtaining and maintaining a DoD secret clearance
• Strong developer skills using SQL and Python
• Hands-on experience with one or more database technologies (e.g., PostgreSQL, Oracle, MySQL, SQL Server, DB2, MongoDB, Neo4j, Couchbase, Cassandra)
• Excellent written and verbal communications skills with ability to describe and present complex technical concepts in relatable terms
• Strong knowledge of ETL/ELT processes, tools, and frameworks
• Experience with large scale data architectures
• Experience building conceptual, logical, and physical data models
• Knowledge of cloud platforms and technologies such as Amazon Web Services, Microsoft Azure, and Google Cloud Platform
• Proficiency in one or more modern programming languages such as Python, R, Scala, C++, Java, C#, and JavaScript
• Expertise in preparing data for analysis
• Strong understanding of data science concepts
• Experience with BI tools
• Understanding ML frameworks, algorithms, and libraries
• Applied mathematics: probability and statistics
• Strong innovation, problem-solving, systems analysis, planning, organizational, and interpersonal skills
• Knowledge of data management practices that align with modern/emerging analytics techniques
• Desire to continuously learn new techniques and evolve approaches by regularly engaging in structured educational pursuits, personal research, and outreach to subject matter experts across the corporation

Nice-to-haves

• Master's degree or PhD in computer science, data science, systems engineering, software engineering, or information systems
• Experience migrating Legacy data systems to new/modernized platforms
• Hands-on experience with data flow and pipeline frameworks such as Kafka, NiFi, Spark, Airflow, and Hadoop
• Familiarity with microservice architectures, data warehousing, data fabric, data lakes, and data mesh
• Understand the use of data in AI/ML and LLM
• Knowledge and experience across data management domains, including data science, data governance, metadata management, data quality, business intelligence, data security & privacy, and data strategy
• Experience performing source to target data mapping
• Knowledge of natural language processing techniques

Benefits

• Competitive benefits
• Exceptional professional development opportunities
• Culture of innovation that embraces diversity, inclusion, flexibility, collaboration, and career growth