Solugenix Corporation - San Antonio, TX
posted about 2 months ago
The Sr. Data Reliability Engineer position is a critical role within a prestigious investment management company, focusing on ensuring the highest standards of data reliability and system performance. This hybrid position, based in either San Antonio, TX or Irvine, CA, requires a blend of expertise in data pipeline technologies and Site Reliability Engineering (SRE) principles. The successful candidate will be responsible for designing, building, and maintaining the infrastructure and data pipelines that support data transformation, data structures, metadata, dependency, and workload management. In this role, you will develop and maintain scalable, reliable, and cost-effective data solutions utilizing AWS technologies and big data tools such as Databricks, Airflow, and Dremio. You will implement robust monitoring and alerting systems using tools like Datadog to ensure proactive management of production environments. Collaboration with data scientists and analytics teams is essential to engineer and optimize data models using DBT (Data Build Tool), ensuring seamless data flow across all segments. The position also involves enhancing data validation and data quality metrics integration within data pipelines to ensure the accuracy and reliability of data. You will automate manual processes, optimize data delivery, and redesign infrastructure for greater scalability. Additionally, you will handle the deployment of additional AWS services, manage data storage solutions, and collaborate with IT and DevOps teams to enhance system performance and reliability. Continuous improvement efforts will be a key focus, as well as providing support and mentorship to offshore teams, ensuring best practices in coding, testing, and deployment are followed. Troubleshooting complex issues across multiple databases and working with various stakeholders to maintain robust architecture and operational standards will also be part of your responsibilities.