Cynet Systems - Richmond, VA
posted 2 months ago
We are seeking a Senior Databricks Cloud Data Engineer to join our team remotely. This role is pivotal in understanding the technology vision and strategic direction of our business needs. The successful candidate will have a comprehensive understanding of our current data model and infrastructure, proactively identifying gaps and areas for improvement. You will be responsible for prescribing architectural recommendations with a focus on performance and accessibility, ensuring that our analytics systems are robust and efficient. In this position, you will partner across engineering teams to design, build, and support the next generation of our analytics systems. Collaborating with business and analytics teams, you will gather specific requirements for data systems that support both the development and deployment of data workloads, which range from Tableau reports to ad hoc analyses. You will own and develop the architecture that translates analytical questions into effective reports that drive business action. Your role will also involve automating and optimizing existing data processing workloads by recognizing patterns of data and technology usage and implementing effective solutions. You will need a solid grasp of the intersection between analytics and engineering, maintaining a proactive approach to ensure that solutions demonstrate high levels of performance, privacy, security, scalability, and reliability upon deployment. Additionally, you will provide guidance to partners on the effective use of the database management systems (DBMS) platform through collaboration, documentation, and adherence to standard methodologies. You will design and build end-to-end automation to support and maintain software currency, creating automation services for builds using Terraform, Python, and OS shell scripts. Developing validation and certification processes through automation tools will also be part of your responsibilities. You will design integrated solutions in alignment with design patterns, blueprints, guidelines, and standard methodologies for products, and participate in developing solutions by incorporating cloud-native and third-party vendor products. Researching and performing proofs of concept (POCs) with emerging technologies will be essential, as will adopting industry best practices in the data space to advance our cloud data platform. You will develop data streaming, migration, and replication solutions, demonstrating leadership, collaboration, exceptional communication, negotiation, strategic, and influencing skills to gain consensus and produce the best solutions. Engaging with senior leadership and business leaders at the client will be crucial to share the business value of your work.