Data Engineer with Databricks

Derex Technologies - Dallas, TX

Full-time - Mid Level

Dallas, TX

Professional, Scientific, and Technical Services

About the position

As a Data Engineer at Derex Technologies, you will play a crucial role in designing, building, and maintaining data pipelines and architectures that support data-driven decision-making across the organization. This position involves collaboration with the data science team to develop and implement data solutions tailored to the needs of business stakeholders, ensuring data quality, integrity, and security.

Responsibilities

• Design and implement scalable, efficient, and reliable data pipelines
• Develop and maintain data warehouses, data lakes, and data marts using technologies such as Amazon Snowflake
• Collaborate with data scientists to develop and deploy data models, algorithms, and machine learning pipelines
• Ensure data quality, integrity, and security by implementing data validation, data governance, and data protection policies
• Work with cross-functional teams to integrate data into our products and services
• Stay up-to-date with the latest developments in data engineering and architecture

Requirements

• BS or MS in Computer Science, Information Technology, or related field
• 3+ years of experience in data engineering, data architecture, or related field
• Strong programming skills in languages such as Java, Python, or Scala
• Experience with big data technologies such as Hadoop, Spark, or NoSQL databases
• Familiarity with cloud-based infrastructure and containerization technologies, such as Docker or Kubernetes
• Excellent problem-solving skills and ability to work in a fast-paced, dynamic environment

Nice-to-haves

• Experience with data warehousing, data lakes, and data marts
• Familiarity with data governance, data validation, and data protection policies
• Knowledge of data modeling, data architecture, and data engineering principles
• Experience with DevOps tools and practices, such as continuous integration and continuous deployment (CI/CD)
• Certification in data engineering or related field (e.g., Certified Data Engineer or Certified Big Data Engineer)