Pyramid Technology Solutions - Los Angeles, CA
posted 2 months ago
The Senior Data Engineer will play a pivotal role in designing, implementing, and maintaining data solutions that support the organization's data strategy. This position requires a deep understanding of the Azure ecosystem, including Azure Data Factory, Data Lake Storage, and Blob Storage, as well as proficiency in big data technologies such as Databricks and Spark. The ideal candidate will have extensive experience in data engineering fundamentals, including ETL/ELT processes, data pipelines, and data modeling. The role also involves working with various programming languages, primarily Python and SQL, and a solid understanding of data warehousing and business intelligence tools like Power BI and Tableau. In this role, the Senior Data Engineer will be responsible for developing and optimizing data models and pipelines, ensuring data quality and governance, and implementing best practices for data security and compliance. The candidate will also be expected to leverage their knowledge of API management, particularly with tools like Apigee, to enhance data accessibility and integration across platforms. The position requires a strong focus on automation and efficiency, utilizing DataOps principles to streamline data resource management in Azure. The Senior Data Engineer will collaborate with cross-functional teams to ensure that data solutions align with business objectives and support decision-making processes. This role is critical in driving the organization's data initiatives and requires a proactive approach to problem-solving and innovation in data engineering practices.