ICF International - Reston, VA
posted about 2 months ago
ICF is a mission-driven company filled with people who care deeply about improving the lives of others and making the world a better place. Our core values include Embracing Difference; we seek candidates who are passionate about building a culture that encourages, embraces, and hires dimensions of difference. Our Health Engineering Systems (HES) team works side by side with customers to articulate a vision for success, and then make it happen. We know success doesn't happen by accident. It takes the right team of people, working together on the right solutions for the customer. We are looking for a seasoned Senior Data Engineer who will be a key driver to make this happen. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines using technologies such as Spark, Hive, and Airflow. You will develop and deploy data processing workflows on the Databricks platform and create API services to facilitate data access and integration. Your role will also involve creating interactive data visualizations and reports using AWS QuickSight, building the required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS and SQL technologies. You will monitor and optimize the performance of data infrastructure and processes, develop data quality and validation jobs, and assemble large, complex sets of data that meet both non-functional and functional business requirements. In addition, you will be responsible for writing unit and integration tests for all data processing code, working with DevOps engineers on CI, CD, and IaC, and translating specifications into code and design documents. You will perform code reviews and develop processes for improving code quality, improve data availability and timeliness by implementing more frequent refreshes, tiered data storage, and optimizations of existing datasets, and maintain security and privacy for data at rest and while in transit. Other duties may be assigned as necessary.