Vistraposted 7 days ago
Irving, TX
Utilities

About the position

Technical role focused on designing, building, and maintaining the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from various sources. This position is responsible for ensuring the availability, reliability, and performance of data systems and supports trading analysts by providing clean and well-structured data for advanced analytics use cases. The Data Engineer will work closely with trading analysts and IT teams to ensure that data pipelines are robust, scalable, and aligned with business needs.

Responsibilities

  • Design, build, and maintain efficient and scalable pipelines to support ingestion, transformation, and storage
  • Develop and optimize ETL processes to ensure timely and accurate data availability for analytics and BI
  • Implement data quality and validation processes to ensure the integrity and reliability of data
  • Manage and monitor data systems to ensure high availability, reliability, and performance
  • Maintain comprehensive documentation of data infrastructure, processes, and systems
  • Troubleshoot and resolve data-related issues, ensuring minimal disruption to business operations
  • Work closely with trading analysts and IT to understand data requirements and deliver solutions
  • Provide support to trading analysts by ensuring they have access to clean, well-structured data
  • Stay updated with the latest trends and technologies in data engineering and implement best practices to enhance data infrastructure
  • Continuously evaluate and improve existing data pipelines and systems to increase efficiency and scalability
  • Identify opportunities for automation and implement solutions to reduce manual data handling tasks

Requirements

  • Extensive training in computer science, engineering, data science, or a related field
  • 5+ years of relevant work experience in data engineering, data management, or a related role
  • Strong proficiency in programming languages such as Python, SQL, and experience with data processing frameworks like Apache Spark or Hadoop
  • Experience with cloud platforms such as AWS, Google Cloud, or Azure, and familiarity with data warehousing solutions like Snowflake or Redshift
  • Excellent problem-solving skills and attention to detail, with a focus on data quality and reliability
  • Strong communication and teamwork skills, with the ability to collaborate effectively with data scientists, analysts, and other stakeholders
  • A keen interest in the energy trading sector and a commitment to staying updated with industry trends and developments

Job Keywords

Hard Skills
  • Apache Hadoop
  • Google Cloud Platform
  • Python
  • Snowflake
  • SQL
  • 2U0A4 WuKCsHvlDeN
  • 34gY6I7JTM mRWPz2CBvAIQ7u
  • 4eyX ld4WEILf59oU PS3blgRp20q
  • 5akVW fwlGSADFB6
  • 5BX0z QVS2KcA4hoza
  • ahoqbltF z4dSb5XsiHN
  • boma78Z 2OXs6woq
  • bvJ9W bEg6Fkc0
  • czYKs qJ8u4Z9XMlAvoVI
  • Dltiz U09pnfH8kmvl
  • dTwFY58J9 0xNlLnabWp
  • fE4nN5heV 8uVATp1z4IS
  • gtQyc02aH tripRmN
  • hvu82wFK oqyljFg4bH 2NYMl
  • HyKvYsk7xLB1 m754CBWIla
  • jpfNLW8Zc0h qOpYkBKistlX r5OL68os
  • jpI7M GD3j1xO7Bapfk
  • KZnYeIa1S 6A8SuvG
  • lBf4Q tLVHpaM0wQj
  • n0O3cuDLo HmO971tJ
  • ngUIr 3VQo8hNnDrtHC4j
  • Rh2db R9m1qbPXGF
  • sIwv26Z7h t7HroNe2uO
  • Spg7V YN6GJ5S02yHXpRA
  • t6c4D Msz2iNnZWbj anXRNh1E
  • TAXDaiyhf ZGTsQ64o
  • u4lwM y4XBEONQn13
  • WdXIi K7X4z2QV6vx
  • zcr8s EWzfmis1MbUx
Soft Skills
  • a7coxzK9 iIHDcubZ
Build your resume with AI

A Smarter and Faster Way to Build Your Resume

Go to AI Resume Builder
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service