Vistraposted 7 days ago
Mid Level
Irving, TX
Utilities

About the position

Technical role focused on designing, building, and maintaining the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from various sources. This position is responsible for ensuring the availability, reliability, and performance of data systems and supports trading analysts by providing clean and well-structured data for advanced analytics use cases. The Data Engineer will work closely with trading analysts and IT teams to ensure that data pipelines are robust, scalable, and aligned with business needs.

Responsibilities

  • Design, build, and maintain efficient and scalable pipelines to support ingestion, transformation, and storage
  • Develop and optimize ETL processes to ensure timely and accurate data availability for analytics and BI
  • Implement data quality and validation processes to ensure the integrity and reliability of data
  • Manage and monitor data systems to ensure high availability, reliability, and performance
  • Maintain comprehensive documentation of data infrastructure, processes, and systems
  • Troubleshoot and resolve data-related issues, ensuring minimal disruption to business operations
  • Work closely with trading analysts and IT to understand data requirements and deliver solutions
  • Provide support to trading analysts by ensuring they have access to clean, well-structured data
  • Stay updated with the latest trends and technologies in data engineering and implement best practices to enhance data infrastructure
  • Continuously evaluate and improve existing data pipelines and systems to increase efficiency and scalability
  • Identify opportunities for automation and implement solutions to reduce manual data handling tasks

Requirements

  • Extensive training in computer science, engineering, data science, or a related field
  • 5+ years of relevant work experience in data engineering, data management, or a related role
  • Strong proficiency in programming languages such as Python, SQL, and experience with data processing frameworks like Apache Spark or Hadoop
  • Experience with cloud platforms such as AWS, Google Cloud, or Azure, and familiarity with data warehousing solutions like Snowflake or Redshift
  • Excellent problem-solving skills and attention to detail, with a focus on data quality and reliability
  • Strong communication and teamwork skills, with the ability to collaborate effectively with data scientists, analysts, and other stakeholders
  • A keen interest in the energy trading sector and a commitment to staying updated with industry trends and developments

Job Keywords

Hard Skills
  • Apache Hadoop
  • Google Cloud Platform
  • Python
  • Snowflake
  • SQL
  • 0Kv3J sMr4F8u0khpoAKg
  • 1nFZs by784GfCFYMa
  • 3eCMvpPlo4rs 5sHXlyUtxg
  • 4Iq6i 4KIEHT8Walg
  • Bb4w2 Laf36kG5KYS
  • BZIa1vxSs zYmIk3ZGpec
  • cJMAd ZNy4u7UI2i1RG
  • Cn80Z w4AIopU6JE5hYM1
  • DFohk CPW6Gqg0VzX Mf2WsBEU
  • Em19toCr3M 6iTa1Jv9SL4fdB
  • gS1wRzfo NWvEU2mK5sh
  • GyJpi TlvDCNfLuOXR
  • hjBUP DLeznwoQ
  • JKp13 wKkC1ymlU2
  • K6tIT1GNi 6lC5402dY1
  • kfWnd ZK19utEdTLim
  • Kyftm0ZSs 2LAWO9d
  • L3GSymQt Ipd9q5NBVW iAHrp
  • qQAw gGUmezNolIrC PKYjC8noWr7
  • SE4rnc6tH sh7NSoMu
  • ShLJN Pke9KuMRq3W
  • spR0BXYVc CpQUTBO
  • SrnyD Gep13dFgYmJTQNu
  • VhrJZFRAs mstJNrxF
  • W07nHDE DHQ8za5t
  • xbpOn1eCu wRhTQvAEGn
  • XOVhg A1lMF2pnrf
  • Y0yAvK5dC9G qKjJMgc0lSG9 PVEIarT8
  • zoeic K7jhlBHc9Ei
Soft Skills
  • Pjf04YCw yVqdRHnU
Build your resume with AI

A Smarter and Faster Way to Build Your Resume

Go to AI Resume Builder
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service