Kls Martin - Jacksonville, FL

posted about 2 months ago

Full-time
Jacksonville, FL
Miscellaneous Manufacturing

About the position

The Data Engineer position at KLS Martin involves designing, building, and maintaining the data infrastructure and systems necessary for collecting, storing, and analyzing large datasets. This role is crucial for supporting high-visibility data pipelines and products, working closely with data analysts, ETL developers, and other stakeholders to create a robust data architecture.

Responsibilities

  • Design, construct, install, test, and maintain highly scalable data management systems.
  • Develop and maintain efficient data pipelines for ETL (Extract, Transform, Load) processes.
  • Optimize data storage and retrieval processes for performance and reliability.
  • Design and optimize data warehouse architecture to support the storage and retrieval of structured and unstructured data.
  • Implement data partitioning, indexing, and optimization techniques to enhance query performance.
  • Create and maintain data structures and database schemas that support data warehousing and business intelligence.
  • Implement and manage database solutions using SQL and NoSQL databases.
  • Ensure data quality, integrity, and security across all databases.
  • Integrate data from various sources into the data warehouse or data lake.
  • Work with APIs to extract data from external systems.
  • Collaborate with software engineers to integrate data processing and storage solutions within the broader technical architecture.
  • Apply best practices in data modeling and transformation to ensure data consistency, integrity, and quality throughout the integration process.
  • Implement data enrichment, cleansing, and normalization techniques as necessary.
  • Ensure compliance with data governance and security policies.
  • Implement data quality measures and monitor data integrity.
  • Maintain documentation for data processes, structures, and architecture.
  • Work closely with data scientists, analysts, and other stakeholders to understand their data needs.
  • Provide technical support and troubleshooting for data-related issues.
  • Train and mentor junior data engineers and other team members.
  • Collaborate with application developers and IT teams to integrate data from business-critical applications into our data ecosystem.
  • Develop APIs, connectors, and middleware solutions to facilitate seamless data exchange between applications and data repositories.
  • Monitor and optimize data processing and storage infrastructure for performance, scalability, and cost efficiency.

Requirements

  • Bachelor's Degree in a technical field or equivalent work experience.
  • Proven experience as a Data Engineer or in a similar role.
  • Experience with data warehousing, ETL processes, and big data technologies.
  • Proficiency in SQL and experience with NoSQL databases.
  • Experience with Informatica preferred.
  • Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud).
  • Experience with cloud-based data platforms (e.g., Snowflake, Azure Synapse).
  • Experience with Azure Data Factory, Synapse, and Spark preferred.
  • Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus.
  • Experience with Data Warehouse Automation & Data Vault 2.0 preferred.
  • Experience with Microsoft Fabric/Synapse/OneLake preferred.
  • Experience understanding data requirements and performing data preparation and feature engineering tasks to support model training and evaluation preferred.
  • Experience with EDI preferred.

Nice-to-haves

  • Experience with data pipeline and data warehouse automation tools (e.g., Wherescape).
  • Knowledge of distributed systems and big data processing frameworks (e.g., Hadoop, Spark).
  • Experience with formal software development life cycle is preferred.

Benefits

  • Competitive benefits package including paid parental leave.
  • In-house training and professional development opportunities.
Job Description Matching

Match and compare your resume to any job description

Start Matching
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service