Unclassified - Alpharetta, GA
posted 4 months ago
CLIENT is seeking a talented Sr IT Architect specializing in Big Data to innovate and engineer solutions in the area of database technology. This role is crucial for individuals who are enthusiastic about applying bold new ideas to solve real-world data problems. The Data Engineering team is actively engaged in the ongoing database engineering process, partnering with development groups and providing deep subject matter expertise input as stakeholders to design reviews. The architect will also act as an advocate for bringing forward and resolving customer issues, ensuring that the solutions developed meet the needs of the business and its clients. The ideal candidate will have a strong background in data warehousing, with at least 5 years of experience in this area, preferably within a data platform. Additionally, the candidate should have extensive experience in ETL processes, particularly with semi-structured and unstructured data sets. A minimum of 7 years of experience with several programming languages such as Python, Scala, or Java is required, along with experience in Spark streaming and SQL. The role demands coding skills in procedural languages for at least one database engine, such as PL/SQL or T-SQL, and familiarity with micro-service architecture/design. Candidates should also have experience in Test Driven Development (TDD) and Continuous Integration/Continuous Deployment (CI/CD), as well as knowledge of DAG workflow scheduler systems. The ability to quickly learn new languages and technologies is essential, as is experience with NoSQL data stores like Dynamo DB, HBase, Cassandra, or MongoDB. Familiarity with data warehousing solutions such as Hive and scalable stores like Snowflake or Redshift is also important. The architect will work with one or more streaming platforms, such as Apache Kafka, Spark Streaming, Storm, or AWS Kinesis, and should be experienced in various clustering and sharding architectures. Excellent SQL and database performance tuning skills are a must, and experience with Kubernetes is a plus. Strong leadership skills and the ability to communicate effectively with stakeholders of different backgrounds and skill levels are essential for success in this role.