Sr Data Engineer

Infomatics Incorporated - Irving, TX

Full-time - Mid Level

Irving, TX

Professional, Scientific, and Technical Services

About the position

We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in designing, developing, and maintaining our data infrastructure. This role requires a deep understanding of data engineering principles, big data technologies, and cloud platforms.

Responsibilities

• Design, develop, and deploy robust data pipelines to ingest, process, and transform large volumes of data from various sources.
• Utilize a variety of tools and technologies, such as Apache Spark, Kafka, and SQL, to extract, transform, and load (ETL) data.
• Develop and implement data models and schemas that are efficient, scalable, and aligned with business needs.
• Design and maintain data warehouses, data marts, and data lakes.
• Leverage cloud platforms like AWS, Google Cloud Platform, or Azure to build and manage data solutions.
• Utilize cloud-native services for data storage, processing, and analytics.
• Ensure data quality and consistency through rigorous testing and validation.
• Implement monitoring and alerting systems to proactively identify and resolve data issues.
• Optimize data pipelines and queries for optimal performance and efficiency.
• Identify and resolve performance bottlenecks.
• Collaborate with data analysts, data scientists, and business stakeholders to understand their data needs.
• Work effectively in a cross-functional team environment.

Requirements

• Strong proficiency in SQL and Python or Scala.
• Experience with big data technologies such as Hadoop, Spark, Kafka, and Hive.
• Knowledge of cloud platforms (AWS, Google Cloud Platform, or Azure) and their data services.
• Understanding of data warehousing and data lake concepts.
• Experience with data modeling and ETL processes.
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration skills.

Nice-to-haves

• Experience with data visualization tools like Tableau or Power BI.
• Knowledge of machine learning and AI concepts.
• Certifications in cloud platforms or data engineering.