Kforce - Dallas, TX

posted about 2 months ago

Full-time - Senior
Dallas, TX
Administrative and Support Services

About the position

Kforce has a client that is seeking a Senior Data Engineer - Azure Synapse Analytics in Dallas, TX. In this role, you will be responsible for designing, developing, and maintaining robust data pipelines and infrastructure to support data integration, processing, and storage. You will collaborate with analysts and other stakeholders to understand data requirements and translate them into technical solutions. Implementing best practices for data governance, security, and quality assurance will be crucial to ensure the reliability and accuracy of data. You will also explore and evaluate new technologies and tools to enhance our data infrastructure and capabilities. A significant part of your responsibilities will include designing and implementing complex data models on Azure Synapse Analytics to support data warehousing and big data solutions. Utilizing Azure DevOps for continuous integration, continuous delivery, and agile project management will be essential. Additionally, you will manage and optimize Apache Spark pools for high-performance data processing tasks and develop and maintain ETL processes and data pipelines using Python scripting. Ensuring data quality and integrity across all platforms and systems is a key aspect of this position. You will collaborate with cross-functional teams to translate business needs into technical specifications and stay current with industry trends and advancements in Azure data services.

Responsibilities

  • Design, develop, and maintain robust data pipelines and infrastructure to support data integration, processing, and storage
  • Collaborate with analysts and other stakeholders to understand data requirements and translate them into technical solutions
  • Implement best practices for data governance, security, and quality assurance to ensure the reliability and accuracy of data
  • Explore and evaluate new technologies and tools to enhance our data infrastructure and capabilities
  • Design and implement complex data models on Azure Synapse Analytics to support data warehousing and big data solutions
  • Utilize Azure DevOps for continuous integration, continuous delivery, and agile project management
  • Manage and optimize Apache Spark pools for high-performance data processing tasks
  • Develop and maintain ETL processes and data pipelines using Python scripting
  • Ensure data quality and integrity across all platforms and systems
  • Collaborate with cross-functional teams to translate business needs into technical specifications
  • Stay current with industry trends and advancements in Azure data services

Requirements

  • Bachelor's degree in Computer Science, Data Engineering, or related field
  • 5+ years of experience in data engineering with a proven track record in the Azure ecosystem; A strong focus on building and maintaining data pipelines and infrastructure
  • Experience with data modeling, warehousing, and building ETL pipelines
  • Senior level knowledge of data modeling, processes, and data warehouse concepts
  • Knowledge of data security and privacy practices, especially in the healthcare industry
  • Familiarity with Azure Data Factory, Azure Data Lake Storage, and other Azure data services
  • Expertise in Python scripting and other programming languages such as SQL and Java
  • Strong proficiency in Azure Synapse Analytics, Azure DevOps, and Apache Spark pools
  • Excellent problem-solving skills and ability to work independently and collaboratively in a fast-paced environment
  • Strong communication skills and ability to effectively communicate technical concepts to non-technical stakeholders

Benefits

  • Comprehensive medical, dental, and vision insurance
  • Health Savings Account (HSA)
  • Flexible Spending Account (FSA)
  • 401(k) plan
  • Life insurance
  • Disability insurance
  • Accidental Death and Dismemberment (ADD) insurance
  • Paid time off for salaried personnel
  • Paid sick leave for hourly employees on Service Contract Act projects
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service