Databricks Consultant (with ETL / Talend)

$120,000 - $140,000/Yr

Cognizant Technology Solutions - Hartford, CT

Full-time - Senior

Hybrid - Hartford, CT

Professional, Scientific, and Technical Services

About the position

The Databricks Consultant position at Cognizant involves leading the design and implementation of data integration solutions using various ETL tools, particularly focusing on Databricks and Talend. The role requires extensive experience in data integration and architecture, with responsibilities that include developing and maintaining ETL processes, collaborating with multi-functional teams, and mentoring junior team members. This position is essential for ensuring data accuracy and integrity while supporting business intelligence initiatives through effective data warehousing practices.

Responsibilities

• Lead the design and implementation of data integration solutions using Ab Initio, Talend, and Databricks.
• Be responsible for the development and maintenance of ETL processes to ensure data accuracy and integrity.
• Provide technical expertise in Ab Initio Express>It, External Scheduler, and Ab Initio Metadata Hub.
• Collaborate with multi-functional teams to gather and analyze business requirements.
• Develop and optimize PL/SQL scripts for data extraction, transformation, and loading.
• Implement data warehousing concepts to support business intelligence initiatives.
• Use scheduling basics to ensure timely execution of ETL jobs.
• Ensure data integration processes are aligned with industry standard methodologies.
• Solve and resolve issues related to Ab Initio GDE, Conduct>It, and Co>Operating System.
• Develop Unix Shell Scripts to automate repetitive tasks and improve efficiency.
• Maintain comprehensive documentation for all data integration processes.
• Conduct code reviews to ensure consistency to coding standards and best practices.
• Mentor junior team members and provide guidance on technical challenges.

Requirements

• 8 to 12 years of experience in data integration and architecture.
• Solid background in Ab Initio and related technologies.
• Expertise in PL/SQL and SQL for data manipulation and querying.
• Understanding of data warehousing concepts and ETL processes.
• Proficiency in Unix Shell Scripting for automation and task management.
• Domain knowledge in Property & Casualty Insurance.
• Excellent problem-solving skills and attention to detail.
• Effective communication skills with both technical and non-technical team members.

Nice-to-haves

• Secondary experience in Talend is an added advantage.
• Certifications such as Certified Ab Initio Developer, Oracle PL/SQL Developer Certified Associate, and Certified Data Management Professional (CDMP) are good to have.

Benefits

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long-term/Short-term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan