Next Level Business Services - Irving, TX

posted 2 months ago

Full-time
Irving, TX
Professional, Scientific, and Technical Services

About the position

The Data Engineer position involves collaborative work with the client's technology and business staff on a day-to-day basis. The role requires coding, testing, debugging, implementing, and documenting complex global applications. A key aspect of this position is to negotiate features and associated priorities, helping the team and their customers reach consensus on project goals and deliverables. The Data Engineer will also be responsible for developing and/or leading the development of prototypes, identifying problem causality, business impact, and root causes of issues that arise during the development process. Additionally, the role involves coming up with precise solutions for problems related to object identity and error handling, ensuring that the applications function smoothly and efficiently. The ideal candidate will have a strong background in building data pipelines and will be expected to leverage their technical skills to enhance the data processing capabilities of the organization. This position is critical in ensuring that data flows seamlessly through various systems and that the integrity of the data is maintained throughout the process. The Data Engineer will work closely with other team members to ensure that the solutions developed align with the overall business objectives and technical requirements.

Responsibilities

  • Collaborate with the client's technology and business staff on a daily basis.
  • Code, test, debug, implement, and document complex global applications.
  • Negotiate features and associated priorities with the team and customers.
  • Develop and/or lead the development of prototypes.
  • Identify problem causality, business impact, and root causes of issues.
  • Provide exact solutions for problems related to object identity and error handling.

Requirements

  • Minimum 5 years of work experience in building data pipelines using Python, PySpark, and Django.
  • Hands-on experience with MLOps.
  • Experience with Python and related packages (like NumPy, pandas) for data loading and scraping.
  • Hands-on experience with at least one tool from the Hadoop ecosystem (HDFS, AWS Glue, MapReduce, Yarn, Hive, Pig, Impala, Spark, Kafka).
  • Working experience with relational and non-relational databases and familiarity with data model concepts.
  • Experience working as part of a larger scrum team and understanding of related scrum ceremonies.
  • Working knowledge of Unix/Linux.

Nice-to-haves

  • Knowledge of cloud platforms (e.g., AWS, Azure, Google Cloud Platform).
  • Certification/course on Data Science from a reputed institute/portal.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service