Mid-Level Data Engineer

$120,000 - $140,000/Yr

Atlas Technologies - Alexandria, VA

posted 2 months ago

Full-time - Mid Level
Alexandria, VA
Professional, Scientific, and Technical Services

About the position

We are seeking a Mid-Level Data Engineer with a passion for learning and problem-solving to join our team. The ideal candidate will be responsible for designing and implementing data migration processes, integrating data from various sources, and ensuring the secure and efficient handling of both structured and unstructured data. The successful candidate will play a key role in optimizing and securing our data migration and integration workflows.

Responsibilities

  • Collaborate with data architects and project managers to develop comprehensive data migration strategies for structured and unstructured data.
  • Use Qlik Replicate for real-time replication, Change Data Capture (CDC), and data migration from source databases to target environments.
  • Design, implement, and optimize Talend ETL/ELT pipelines for batch processing and transformation of structured and unstructured data.
  • Ensure data integration across diverse sources into platforms like Azure, AWS, and Dataverse.
  • Automate tasks such as data validation, transformation, and reconciliation to ensure efficiency and consistency.
  • Perform data profiling, cleansing, and transformation to support accurate mapping and merging of data formats.
  • Conduct thorough testing (unit, integration, performance) and ensure the accuracy and completeness of migrated data.
  • Troubleshoot data migration issues, optimize performance, and provide post-migration support.
  • Create and maintain documentation for ETL workflows, data migration scripts, and configuration settings.
  • Collaborate closely with stakeholders to provide status updates and resolve data-related challenges.
  • Stay up-to-date with the latest data engineering tools, technologies, and best practices.

Requirements

  • U.S. Citizenship
  • A minimum of a Department of Defense (DoD) Secret level Security Clearance
  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • 3+ years of experience in data engineering, specifically with data migration and integration projects
  • Hands-on experience with Talend for ETL/ELT processes and Qlik Replicate for data replication and CDC
  • Proficiency in working with both structured and unstructured data
  • Experience with cloud platforms such as Azure or AWS for data migration and storage
  • Strong understanding of data modeling, data architecture, and data governance principles
  • Familiarity with SQL and NoSQL databases, as well as experience with large-scale data integration projects
  • Strong analytical, problem-solving, and debugging skills
  • Excellent verbal and written communication skills for collaboration across teams
  • Ability to work independently and manage multiple priorities in a fast-paced environment.

Benefits

  • Competitive salary
  • Generous benefits package
  • Opportunity to make a positive impact in the community
Job Description Matching

Match and compare your resume to any job description

Start Matching
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service