Senior Data Engineer - Dallas

Motion Recruitment - Fort Worth, TX

Full-time - Mid Level

Fort Worth, TX

251-500 employees

Administrative and Support Services

About the position

The Senior Data Engineer position at a Fortune 500 transportation company in the Dallas Fort Worth area offers a unique opportunity to leverage cutting-edge technology to solve complex business problems. This role is designed for a contract engagement lasting three months, where the selected candidate will participate in all phases of the development process, from inception through transition. The company emphasizes a collaborative environment and advocates for agile processes and test-driven development. The Senior Data Engineer will utilize object-oriented development tools to analyze, model, design, construct, and test reusable objects, ultimately enhancing the codebase and ensuring high-quality deliverables. In this role, the Senior Data Engineer will work closely with source data application teams and product owners to design, implement, and support analytics solutions that provide valuable insights for better decision-making. The position requires implementing data migration and engineering solutions using various Azure products and services, including Azure Data Lake Storage, Azure Data Factory, Azure Functions, and Azure Databricks, among others. The candidate will be involved in multiple aspects of the development lifecycle, including cloud engineering, data modeling, testing, CI/CD pipelines, performance tuning, and production support. The role also entails providing technical leadership within a team environment, mentoring others on technical and domain skills, and leading the development of coding standards, best practices, and privacy and security guidelines. The Senior Data Engineer will be part of a DevOps team that fully owns and supports their product, implementing both batch and streaming data pipelines using cloud technologies. This position is ideal for someone with a strong background in data engineering and analytics, particularly within the Azure ecosystem, who is looking to make a significant impact in a dynamic and innovative company.

Responsibilities

• Work closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisions.
• Implement data migration and data engineering solutions using Azure products and services: Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc.
• Perform multiple aspects involved in the development lifecycle - design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CI/CD pipelines, performance tuning, deployments, consumption, BI, alerting, prod support.
• Provide technical leadership and collaborate within a team environment as well as work independently.
• Be a part of a DevOps team that completely owns and supports their product.
• Implement batch and streaming data pipelines using cloud technologies.
• Lead the development of coding standards, best practices and privacy and security guidelines.
• Mentor others on technical and domain skills to create multi-functional teams.

Requirements

• Bachelor's Degree in Computer Science, Computer Engineering, Technology, Information Systems (CIS/MIS), Engineering or related technical discipline, or equivalent experience/training.
• 3+ years software solution development using agile, DevOps, operating in a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions.
• 3+ years data analytics experience using SQL.
• 2 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI.
• Combination of Development, Administration & Support experience in several of the following tools/platforms: Scripting: Python, Spark, Unix, SQL; Data Platforms: Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, Snowflake; Azure Cloud Technologies: Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Azure Functions; CI/CD: GitHub, Jenkins, Azure DevOps, Terraform; BI Analytics Tool Stack - Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana; Data Warehousing: DataStage, Informatica; Data Governance and Privacy: Informatica Axon and EDC, BigID.
• Expertise with the Azure Technology stack for data management, data ingestion, capture, processing, curation and creating consumption layers.
• Expertise in providing practical direction within the Azure Native cloud services.

Nice-to-haves

• Azure Data Explorer administration skills
• Spark Certification
• Azure Development Track Certification
• 5+ years software solution development using agile, dev ops, product model that includes designing, developing, and implementing large-scale applications or data engineering solutions.
• 5+ years data analytics experience using SQL.
• 3+ years full-stack development experience, preferably in Azure.
• 3+ years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI.
• Airline Industry Experience.