Drc Systems - Dallas, TX

posted 4 months ago

Full-time
Dallas, TX

About the position

As a Data Engineer specializing in Azure, you will play a crucial role in the design and implementation of code migration from Datastage to Databricks and Azure Data Factory. This position requires you to install, set up, and configure Datastage and Databricks, ensuring that all systems are optimized for performance and security. You will be responsible for creating high-level design documents that outline the architecture and processes involved in the migration and integration of data systems. In addition to your technical responsibilities, you will support both application and infrastructure teams in troubleshooting production and non-production issues. Your role will involve utilizing Agile methodologies and tools such as GitHub to accomplish project goals efficiently. You will also be tasked with researching and implementing new technologies that can enhance current processes, improve security, and boost overall performance. Collaboration is key in this role, as you will work closely with software architects and technical leads to ensure that all decisions align with the long-term growth needs of the enterprise. You will also support the development of coding standards and adhere to best practices and security guidelines throughout your work.

Responsibilities

  • Design and implement code migration from Datastage to Databricks and Azure Data Factory.
  • Install, set up, and configure Datastage and Databricks.
  • Create high-level design documents for data architecture and processes.
  • Support application and infrastructure teams in troubleshooting production and non-production issues.
  • Utilize Agile methodologies and GitHub to accomplish project goals.
  • Research and implement new technologies to enhance processes, security, and performance.
  • Support the development of coding standards and adhere to best practices and security guidelines.
  • Collaborate with software architects and technical leads to ensure decisions meet long-term enterprise growth needs.

Requirements

  • Minimum 3 years of development experience in Databricks or Azure Data Factory (ADF).
  • Minimum 3 years of experience working in Azure cloud environment.
  • Minimum 2 years of experience working in Cloud Automation Framework using Terraform.
  • Knowledge and experience working with SQL Server.
  • Experience with GitHub and knowledge of CI/CD concepts.
  • Experience with work management products like GitHub Actions.
  • Bachelor's Degree in Computer Science, Computer Engineering, or related technical discipline, or equivalent experience.

Nice-to-haves

  • Experience with Azure or AWS cloud environments.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service