Unclassified
posted about 2 months ago
ICF is a mission-driven company filled with people who care deeply about improving the lives of others and making the world a better place. Our core values include Embracing Difference; we seek candidates who are passionate about building a culture that encourages, embraces, and hires dimensions of difference. Our Health Engineering Systems (HES) team works side by side with customers to articulate a vision for success, and then make it happen. We know success doesn't happen by accident. It takes the right team of people, working together on the right solutions for the customer. We are looking for a seasoned Senior Data Engineer who will be a key driver to make this happen. In this role, you will design, develop, and maintain scalable data pipelines using Spark, Hive, and Airflow. You will also develop and deploy data processing workflows on the Databricks platform and create API services to facilitate data access and integration. Your responsibilities will include creating interactive data visualizations and reports using AWS QuickSight, building the required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS and SQL technologies, and monitoring and optimizing the performance of data infrastructure and processes. You will develop data quality and validation jobs, assemble large, complex sets of data that meet non-functional and functional business requirements, and write unit and integration tests for all data processing code. Collaboration is key in this position, as you will work with DevOps engineers on CI, CD, and IaC, read specifications and translate them into code and design documents, perform code reviews, and develop processes for improving code quality. You will also improve data availability and timeliness by implementing more frequent refreshes, tiered data storage, and optimizations of existing datasets while maintaining security and privacy for data at rest and in transit. Other duties may be assigned as needed.