Data System Engineer

Soho Square Solutions - Alpharetta, GA

Full-time - Entry Level

Alpharetta, GA

About the position

The Data System Engineer will play a crucial role in the development and maintenance of data systems, focusing on data engineering, data modeling, ETL processes, data warehousing, and data analytics & science. This position requires a strong understanding of both on-premise and cloud platforms, specifically AWS and Azure. The engineer will be responsible for establishing, modifying, and maintaining data structures and associated components according to design specifications. This includes documenting business data requirements and developing conceptual and logical data models at various organizational levels, including enterprise and business unit/domain levels. In collaboration with senior data engineers and architects, the Data System Engineer will create platform-level data models and database designs. The role involves participating in reviews of both personal and colleagues' work to ensure quality and adherence to standards. A working knowledge of core tools used in planning, analyzing, designing, building, testing, configuring, and maintaining assigned applications is essential. The engineer will also engage in the software delivery methodology of the assigned team, which may include Agile, Scrum, Test-Driven Development, or Waterfall, to support the development of data engineering pipelines. The position requires an understanding of infrastructure technologies and components, including servers, databases, and networking concepts. The engineer will write code to develop, maintain, and optimize batch and event-driven processes for managing and analyzing large volumes of structured and unstructured data. Additionally, the role involves metadata integration in data pipelines and automating build and deployment processes using Jenkins to enable faster, high-quality releases.

Responsibilities

• Establish, modify, or maintain data structures and associated components according to design.
• Understand and document business data requirements.
• Develop conceptual and logical data models at the enterprise and business unit/domain level.
• Collaborate with senior data engineers and architects to create platform-level data models and database designs.
• Participate in reviews of own work and colleagues' work.
• Utilize core tools for planning, analyzing, designing, building, testing, configuring, and maintaining applications.
• Engage in the assigned team's software delivery methodology (Agile, Scrum, Test-Driven Development, Waterfall, etc.).
• Write code to develop, maintain, and optimize batch and event-driven processes for data management and analysis.
• Integrate metadata in data pipelines.
• Automate build and deployment processes using Jenkins.

Requirements

• Up to 4 years of software development experience in a professional environment or comparable experience.
• Understanding of Agile or other rapid application development methods.
• Exposure to design and development across one or more database management systems such as DB2, SybaseIQ, Snowflake.
• Familiarity with application and database design, development, and automated testing methods.
• Understanding of big data technology and NoSQL design and development with various data stores (document, column family, graph, etc.).
• General knowledge of distributed (multi-tiered) systems, algorithms, and relational & non-relational databases.
• Experience with Linux and Python scripting, as well as large-scale data processing technology such as Spark.
• Experience with cloud technologies such as AWS and Azure, including deployment, management, and optimization of data analytics & science pipelines.

Nice-to-haves

• Collibra
• Terraform
• Java
• Golang
• Ruby
• Machine Learning Operation deployment