Senior Data Engineering Lead / Architect

Tanisha Systems - Westlake, TX

Full-time - Senior

Westlake, TX

Professional, Scientific, and Technical Services

About the position

The Senior Data Engineering Lead / Architect is responsible for expanding and optimizing data and data pipeline architecture within the Fidelity Data Architecture Data Management & Foundation Services chapter. This hands-on role involves optimizing data flow and collection for cross-functional teams, supporting data management engineers, consultants, analysts, and product managers. The ideal candidate will have extensive experience in modern data technologies, particularly in cloud environments, and will play a critical role in redesigning the company's data architecture to support new products and initiatives.

Responsibilities

• Expand and optimize data and data pipeline architecture.
• Optimize data flow and collection for cross-functional teams.
• Support data management engineers, consultants, analysts, and product managers.
• Ensure optimal data architecture is formulated and delivered.
• Redesign data architecture to support next-generation products and data initiatives.

Requirements

• Masters in Computer Science or related field with at least 20 years of relevant experience.
• Advanced working SQL knowledge and experience with relational databases.
• Experience building and optimizing big data pipelines, architectures, and datasets.
• Experience in cloud services such as AWS EMR, EC2, and Jupyter notebooks.
• Strong analytic skills related to working with unstructured datasets.
• Experience with message queuing, stream processing, and scalable big data stores.
• Strong project management and organizational skills.

Nice-to-haves

• Knowledge of agile methods.
• Experience with AWS cloud services: Snowflake, Elastic-Search.
• Experience with stream-processing systems: Storm, Spark-Streaming, Kafka.
• Experience with object-oriented scripting languages: Python, Java, C++, Scala.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow.
• Experience with data management tools: Collibra, Alation, BigID.

Benefits

• Flexible operational environment.
• Client-centric engagement model.