Senior Data Engineer

CenterPoint Energy - Houston, TX

Full-time - Mid Level

Houston, TX

Utilities

About the position

As a Senior Data Engineer at CenterPoint Energy, you will be responsible for developing and maintaining data pipelines that support analytical analysis. This role involves collaborating with various business clients, data scientists, and data analysts to ensure access to necessary data for informed decision-making. You will leverage a variety of tools and technologies to construct and optimize data architectures, focusing on delivering data in near real-time and improving data quality and efficiency.

Responsibilities

• Develop, construct, test and maintain data acquisition pipelines for large volumes of structured and unstructured data.
• Build large and complex datasets based on business requirements.
• Construct ‘big data' pipeline architecture.
• Identify opportunities for data acquisition by working with stakeholders and business clients.
• Leverage tools such as Python, SAP Data Services, DataFlow, DataStream, Google Cloud Functions, Spark, Google Cloud Run, and SAP SLT to integrate systems and data pipelines.
• Recommend ways to improve data quality, reliability, and efficiency.
• Develop JSON messaging structure for integrating with various applications.
• Drive a data engineering strategy focused on delivering data in near real-time using serverless technologies.
• Develop data architecture to optimize performance for dashboards and digital applications.
• Lead the integration track of various strategic projects.
• Leverage DevOps and CI/CD practices to ensure the reliability and scalability of data pipelines.

Requirements

• Bachelor's degree in Computer Science, Engineering or STEM field from an accredited college or university.
• 5+ years of experience in a data engineering role.
• Strong SQL background working with a variety of data sources.
• Expertise using languages such as Python, Java, or Spark.
• Experience leveraging messaging queue technologies such as Kafka and Pub/Sub.
• Expertise transforming streaming data using technologies such as DataFlow, DataStream, Spark streaming, or DataBricks.
• Expertise developing resilient and scalable data models.
• Expertise developing pipelines for unstructured data.
• Expertise in native cloud back-end technologies such as BigQuery, DataFlow, Pub/Sub, Cloud Functions, Cloud Run.
• Expertise with cloud-based data platforms such as AWS, Azure, or GCP.
• Experience with AI and ML ops.
• Experience with AI and machine learning.
• Experience with DevOps and deploying and maintaining CI/CD pipelines.

Benefits

• Competitive pay
• Paid training
• Benefits eligibility begins on your first day
• Transit subsidies
• Flexible work schedule, paid holidays and paid time off
• Access to discounts at fitness clubs and an on-site wellness center at our headquarters in Houston
• Professional growth and development programs including tuition reimbursement
• 401(k) Savings Plan featuring a company match dollar-for-dollar up to 6% and a company contribution of 3% regardless of your contribution