Python and PySpark Data Engineer - Remote
This job is no longer available
There are still lots of open positions. Let's find the one that's right for you.
About The Position
NTT DATA is seeking a Python and PySpark Data Engineer to join our remote team based in Frisco, Texas. This role is designed for individuals who are exceptional, innovative, and passionate about data engineering. As part of our agile development team, you will be responsible for designing, developing, and maintaining scalable data pipelines that utilize software development patterns. You will implement data processing solutions using Python and PySpark on a cloud-native Lakehouse data platform, ensuring that our data infrastructure is robust and efficient. In this position, you will write efficient SQL queries to extract, transform, and load data, collaborating closely with product management and analysts to understand data requirements and deliver effective solutions. Your role will also involve optimizing and troubleshooting data pipelines to enhance performance and reliability, while ensuring data quality and integrity through comprehensive testing and validation processes. You will follow DevOps principles and utilize CI/CD practices to deploy and operate data pipelines effectively. This position requires a strong foundation in data engineering principles, with a focus on creating efficient and reliable data processing solutions. You will be expected to leverage your expertise in Python, PySpark, and SQL to contribute to the success of our data initiatives, while also being open to continuous learning and adaptation in a fast-paced environment.
