Pinnacle Group - Columbus, OH
posted 2 months ago
The Senior Data Engineer position is a critical role within our IT department, focusing on software design and development. This position is based in Columbus, Ohio, and is offered as a contract role with the potential for contract-to-hire. The selected candidate will be expected to work in a hybrid model, with onsite presence required from day one. The primary responsibility of the Senior Data Engineer will be to design and develop data ingestion pipelines utilizing AWS services and the Databricks platform. This work is essential for enabling downstream applications and creating Tableau dashboards that provide valuable insights across various functions of the Employee Platform. In this role, the Senior Data Engineer will collaborate closely with cross-functional teams to ensure that the data pipelines are efficient, reliable, and scalable. The engineer will leverage their expertise in Python and PySpark to build robust data solutions that meet the evolving needs of the business. The position requires a strong understanding of AWS services, including EC2, S3, Lambda, and EMR, to effectively manage and process large datasets. The engineer will also be responsible for troubleshooting and optimizing existing data workflows to enhance performance and reduce latency. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a proven track record of successfully implementing data solutions in a cloud environment. This role is pivotal in driving business value through data, and the Senior Data Engineer will play a key role in shaping the data strategy for the organization.