Randstad - Folsom, CA
posted 2 months ago
We have a Direct Hire Opportunity for a Senior Data Engineer in Folsom, CA. This position will work a hybrid schedule with roughly 50% onsite depending on the business needs. The Senior Data Engineer will be responsible for enforcing standards, data engineering principles, and practices while designing, building, deploying, automating, and maintaining end-to-end data pipelines for new and existing data sources and targets utilizing modern ETL/ELT tools and practices, including stream processing technologies where appropriate. This role requires a strong problem-solving ability that allows the team to resolve issues in a timely and effective manner. The Senior Data Engineer will drive and complete project deliverables within the data engineering and management area according to project plans. The ideal candidate will utilize in-depth technical expertise regarding data models, data analysis and design, master data management, metadata management, reference data management, data warehousing, business intelligence, and data quality improvement. They should have the ability to influence internal clients to leverage standard capabilities and make data-driven decisions. The role also involves working with internal technical resources to optimize the data Lakehouse through hardware or software upgrades or enhancements. The Senior Data Engineer will design and implement data models that balance performance, flexibility, and ease of use, considering both analytical and operational needs. They will enable and support self-service analytics by designing intuitive data models and views, collaborating with the Business Intelligence team to ensure data is easily accessible and interpretable for business partners. Additionally, the Senior Data Engineer will manage and automate the deployment of upgrades, patches, and new features across the data infrastructure, ensuring minimal disruption to data services and maintaining system integrity. They will conduct code reviews and approvals for data pipelines developed and implemented by the team, ensuring compliance with all data Lakehouse administration activities. The role requires designing and managing the implementation of data models to meet user specifications while adhering to prescribed standards. The Senior Data Engineer will also manage and collect business metadata and data integration points, coordinate with business analysts to prepare data design for systems, analyze user requirements, and prepare technical design specifications to address user needs. Furthermore, they will develop and implement comprehensive testing strategies, including automated unit, integration, and end-to-end tests, to ensure the accuracy, reliability, and performance of data pipelines and procedures. The position also involves enforcing standards and procedures to ensure data is managed consistently and properly integrated within the Lakehouse, creating and maintaining thorough, up-to-date documentation for all data engineering projects, processes, and systems, and implementing business rules via coding, stored procedures, middleware, or other technologies to ensure scalability and maintainability of implemented solutions. Finally, the Senior Data Engineer will analyze processes in specialty areas to isolate and correct problems and improve workflow, while implementing and maintaining robust data quality assurance processes to ensure the integrity, accuracy, and reliability of data across all stages of processing and storage.