TEKsystems - Charlotte, NC
posted 3 months ago
We are looking for a Data Engineer (SQL/SSIS Developer) to join our team at TEKsystems in Charlotte, North Carolina. This role is pivotal in developing database architectures that address business needs while ensuring system security, performance, and reliability. The successful candidate will be responsible for Data Engineering and Security, which encompasses a variety of tasks aimed at creating robust data solutions that meet the demands of our clients. The Data Engineer will work closely with stakeholders to understand their requirements and translate them into technical specifications. This includes developing and managing technical and business metadata, creating and managing Time-Series data from full data snapshots or incremental data changes, and implementing fine-grained access controls using tools like Apache Ranger. The role also involves automating data quality validation in data pipelines and managing automated schema evolution within those pipelines. In addition to these responsibilities, the Data Engineer will be expected to design and build microservices and APIs, with a strong emphasis on SQL and NoSQL database schemas. Familiarity with advanced data formats such as Partitioned Parquet, ORC, and Avro, as well as experience in developing containerized microservices, will be crucial. The ideal candidate will also have a solid understanding of the big data ecosystem and be able to implement automated data change management processes, including code and schema versioning, QA, CI/CD, and rollback processing. This position may require occasional work during nights and weekends for on-call production issue resolution and off-hours system maintenance, ensuring that our data systems remain operational and efficient.