Data Platform Engineer

$145,600 - $145,600/Yr

F.D. Technologies - New York, NY

Full-time - Mid Level

New York, NY

Publishing Industries

About the position

The Data Platform Engineer role at First Derivative involves working closely with Tier 1 investment banks to build and optimize data infrastructure on AWS. This position is designed for experienced data engineering professionals who are skilled in delivering robust data platforms and implementing data fabric solutions, ensuring high performance, data integrity, and secure access across data products.

Responsibilities

• Build and optimize data infrastructure on AWS for customers.
• Deliver robust data platforms and implement data fabric solutions.
• Ensure high performance, data integrity, and secure access across data products.
• Enforce and uphold data quality through validation, cleansing, and governance best practices.

Requirements

• Extensive experience with AWS data ecosystem services such as Lake Formation, EMR, Glue, EC2, and CloudWatch.
• Solid understanding and hands-on experience with open table formats, such as Hudi or Iceberg.
• Proven track record of coding and software development within high-performing data engineering teams.
• Demonstrated experience with cloud automation and deployment using tools like Terraform.
• Strong SQL and Spark skills for effective data transformation and processing.

Nice-to-haves

• Experience in the financial industry, particularly in investment banking.
• Knowledge of additional data processing libraries and tools.
• Expertise in one of the major real-time data processing frameworks, such as Apache Flink or Kafka Streams.
• Experience in building event-driven and/or streaming data services.

Benefits

• Hybrid and Flexible Working
• Extensive Private Healthcare Package
• Private Pension
• Employee Assistance Programme
• Enhanced Maternity/ Paternity policies
• Group Life Protection Benefit
• Employee Referral Bonus Scheme
• Access to a range of skills and certifications such as GCP, AWS, Azure and more!