SQL SSIS Developer

TEKsystems - Charlotte, NC

Full-time - Mid Level

Charlotte, NC

10,001+ employees

Professional, Scientific, and Technical Services

About the position

We are looking for a Data Engineer (SQL/SSIS Developer) to join our team at TEKsystems in Charlotte, North Carolina. This role is pivotal in developing database architectures that address business needs while ensuring system security, performance, and reliability. The successful candidate will be responsible for Data Engineering and Security, which encompasses a variety of tasks aimed at creating robust data solutions that meet the demands of our clients. The Data Engineer will work closely with stakeholders to understand their requirements and translate them into technical specifications. This includes developing and managing technical and business metadata, creating and managing Time-Series data from full data snapshots or incremental data changes, and implementing fine-grained access controls using tools like Apache Ranger. The role also involves automating data quality validation in data pipelines and managing automated schema evolution within those pipelines. In addition to these responsibilities, the Data Engineer will be expected to design and build microservices and APIs, with a strong emphasis on SQL and NoSQL database schemas. Familiarity with advanced data formats such as Partitioned Parquet, ORC, and Avro, as well as experience in developing containerized microservices, will be crucial. The ideal candidate will also have a solid understanding of the big data ecosystem and be able to implement automated data change management processes, including code and schema versioning, QA, CI/CD, and rollback processing. This position may require occasional work during nights and weekends for on-call production issue resolution and off-hours system maintenance, ensuring that our data systems remain operational and efficient.

Responsibilities

• Develop and manage database architectures to address business needs.
• Ensure system security, performance, and reliability.
• Create and manage technical and business metadata.
• Manage Time-Series data from full data snapshots or incremental data changes.
• Implement fine-grained access controls using Apache Ranger.
• Automate data quality validation in data pipelines.
• Implement automated data change management including code and schema versioning, QA, CI/CD, and rollback processing.
• Manage automated schema evolution within data pipelines.
• Design and build microservices and APIs.
• Develop containerized Microservices and APIs.

Requirements

• Hands-on experience developing and managing technical and business metadata.
• Experience creating/managing Time-Series data from full data snapshots or incremental data changes.
• Hands-on experience with implementing fine-grained access controls such as Attribute Based Access Controls using Apache Ranger.
• Experience automating data quality validation in data pipelines.
• Experience implementing automated data change management including code and schema versioning, QA, CI/CD, rollback processing.
• Experience with automating end-to-end data lifecycle on the big data ecosystem.
• Experience with managing automated schema evolution within data pipelines.
• Experience implementing masking and/or other forms of obfuscating data.
• Experience designing and building microservices, APIs, and MySQL.
• Advanced understanding of SQL and NoSQL DB schemas.
• Advanced understanding of Partitioned Parquet, ORC, Avro, and various compression formats.

Nice-to-haves

• Familiarity with key concepts implemented by Apache Hudi or Iceberg, or Databricks Delta Lake.

Benefits

• Medical, dental & vision insurance
• Critical Illness, Accident, and Hospital insurance
• 401(k) Retirement Plan with Pre-tax and Roth post-tax contributions
• Voluntary Life & AD&D insurance for the employee and dependents
• Short and long-term disability insurance
• Health Spending Account (HSA)
• Transportation benefits
• Employee Assistance Program
• Paid Time Off (PTO), Vacation or Sick Leave