Fisec Global - San Francisco, CA
posted 2 months ago
The DevOps Data Platform Engineer will be responsible for designing and implementing scalable and secure data storage solutions in the cloud, ensuring optimal performance and accessibility. This role requires a deep understanding of cloud technologies, particularly Azure, and the ability to create robust data pipelines that integrate various SaaS platforms. The engineer will work closely with cross-functional teams to ensure that data solutions meet business needs while adhering to compliance and security standards. In this position, the engineer will leverage Azure Data Factory and Data Lake Storage, utilizing Azure Private Link for secure integration. They will be tasked with designing zone-redundant and multi-region storage solutions, as well as implementing storage lifecycle policies to manage data efficiently. The role also involves integrating Azure or AWS with SaaS data platforms such as Snowflake, DataIku, Fivetran, and DBT Cloud, focusing on data pipelines, networking, and SSO integrations. A critical aspect of this role is ensuring the secure integration of tools and applications hosted between customer data centers and cloud platforms. The engineer will monitor cloud data systems' performance, identify bottlenecks, and implement improvements to enhance efficiency. Additionally, the engineer will have experience in deploying Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and serverless solutions on both Azure and AWS. Proficiency in using Terraform, Azure Resource Manager (ARM), and CloudFormation Templates (CFT) for Infrastructure as Code (IaC) deployments is essential.