Data Engineer

$125,000 - $125,000/Yr

Livanta - State College, PA

Full-time - Mid Level

Remote - State College, PA

Professional, Scientific, and Technical Services

About the position

Livanta is seeking a seasoned Data Engineer to join its team, responsible for designing, building, and maintaining scalable data pipelines and architectures that support various business needs. This role is crucial in transforming massive amounts of raw data into actionable insights, leveraging cloud technologies, particularly AWS, to enhance healthcare quality improvement initiatives.

Responsibilities

• Design, develop, and maintain scalable data pipelines to collect, process, and transform data from various sources.
• Integrate data from multiple sources, ensuring data quality and consistency across the organization.
• Build and maintain data storage solutions, including data warehouses and data lakes, ensuring optimal performance and reliability.
• Implement data transformation and enrichment processes to prepare data for analysis and reporting.
• Leverage cloud technologies, particularly AWS, to build and manage data infrastructure.
• Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Create and maintain comprehensive documentation for data pipelines, data models, and related processes.

Requirements

• Bachelor's degree in computer science, Information Technology, or a related field; Master's degree preferred.
• Minimum of 4 years of experience in data engineering or a related field.
• Strong experience with data pipeline/orchestration and ETL development using tools such as Apache Airflow, Kubernetes, or similar.
• Competent in designing highly efficient programs capable of processing TBs of data.
• Proficiency in SQL and experience with relational databases (e.g., SQLServer, PostgreSQL) and NoSQL databases (e.g., MongoDB, OpenSearch).
• Experience with cloud technologies, particularly AWS (e.g., S3, Redshift, Glue, Lambda, Athena).
• Strong programming skills in Python, Java, or similar languages.
• Familiarity with big data technologies such as Apache Spark.
• Excellent problem-solving skills and attention to detail.
• Strong communication and interpersonal skills, with the ability to work effectively with diverse teams and stakeholders.

Nice-to-haves

• Familiarity with data governance and data quality best practices is a plus.
• Familiarity with healthcare data standards i.e. (FHIR, HL7)
• Familiarity working with unstructured data i.e. pdfs, free-text, etc.
• Data Visualization/Reporting skills (i.e. PowerBI, Tableau, or Quicksight)

Benefits

• Full-time telecommuting options available.