Data Engineer

E-Solutions Group - Tampa, FL

Full-time - Senior

Tampa, FL

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

The Data Engineer position is a senior-level role focused on creating high-quality software products within the AML Quantexa workstream. The role involves managing, transforming, cleansing, and resolving entities of high-volume data while collaborating closely with client technical leads and the principal data engineer. The successful candidate will utilize open-source big data technologies and tools, primarily working with Scala and Spark, in an Agile environment to meet project expectations and deliver exceptional service.

Responsibilities

• Demonstrating deep technical knowledge and expertise in software development including programming languages, frameworks, and best practices.
• Providing guidance and mentorship to junior team members.
• Actively contributing to the implementation of critical features and complex technical solutions.
• Writing clean, efficient, and maintainable code that meets the highest standards of quality.
• Writing defensive, fault-tolerant, and efficient code for data processing.
• Providing guidance on scalable, robust, and efficient solutions that align with business requirements and industry best practices.
• Using emerging and open-source technologies such as Spark, Hadoop, and Scala.
• Collaborating on scalability issues involving access to massive amounts of data and information.
• Taking on ad-hoc tasks as required.

Requirements

• 8 years experience of implementing data-intensive solutions using agile methodologies.
• Proficient in programming languages commonly used in data engineering such as Scala, Spark, Python, and Java.
• Experience of building data processing pipelines for use in production, including traditional ETL pipelines and/or analytics pipelines.
• Strong coding experience in Scala, Java, or Python.
• Enthusiasm to learn and develop emerging technologies and techniques.

Nice-to-haves

• Quantexa Certified Data Engineer
• Familiarity with open-source data engineering tools and frameworks such as Spark, Kafka, and Trino.
• Exposure to a range of table and file formats including Hive, Parquet, and JSON.
• Experience in cloud-native technologies and patterns such as AWS and Google Cloud.
• Experience of driving and/or influencing the data strategy of your team or organization.