Data Operations Lead Analyst

Techwizens LLC - Boston, MA

Full-time

Boston, MA

About the position

The Data Operations Lead Analyst will play a crucial role in ensuring the smooth execution and optimization of data workflows. This position focuses on maintaining operational excellence, troubleshooting job failures, and overseeing the end-to-end execution of data processes using tools such as Apache Airflow and Informatica Intelligent Cloud Services (IICS).

Responsibilities

• Maintain scalable data pipelines using Apache Airflow and IICS to ensure efficient data processing and integration.
• Proactively monitor job performance and troubleshoot issues to ensure data integrity and reliability.
• Address and resolve job failures promptly to minimize downtime.
• Provide oversight and management of job executions, ensuring adherence to SLAs and optimizing workflows for performance and efficiency.
• Work closely with cross-functional teams including data engineers, data analysts, and IT operations to understand requirements, troubleshoot issues, and implement solutions.
• Document operational procedures, workflows, and best practices.
• Continuously improve processes to enhance reliability and scalability.

Requirements

• Proven experience in data operations, managing and troubleshooting data workflows.
• Hands-on experience with Apache Airflow and Informatica IICS.
• Strong debugging and problem-solving skills with the ability to analyze complex issues and drive resolution.
• Solid understanding of data integration concepts and best practices.
• Experience in scripting (Python, Shell scripting) along with Spark and working in a Linux environment is a plus.
• Excellent communication skills and ability to work effectively in a team-oriented environment.
• Experience with cloud platforms (AWS) and containerization technologies (Docker, Kubernetes).
• Familiarity with database systems and SQL.
• Certification in Apache Airflow / Informatica IICS / AWS Developer is a plus.

Nice-to-haves

• Experience in scripting (Python, Shell scripting) along with Spark and working in a Linux environment is a plus.
• Certification in Apache Airflow / Informatica IICS / AWS Developer is a plus.