Data Engineer Architect in Alpharetta, GA / Atlanta, NJ / CA (Hybrid)

Brilliant Infotech - Alpharetta, GA

Full-time - Senior

Alpharetta, GA

Administrative and Support Services

About the position

The Data Engineer Architect role is a senior position responsible for creating high-level software designs and establishing technical standards for data solutions. This includes defining processes for non-functional governance, collaborating with stakeholders, and designing holistic technical architecture solutions that align with customer requirements and cost constraints. The role requires extensive experience in software engineering, architecture, and big data technologies, with a focus on performance tuning and capacity planning.

Responsibilities

• Analyzing and designing effective technical solutions for infrastructure and enterprise applications.
• Providing high-level and detailed designs as needed, and updating solutions according to project evolution.
• Analyzing performance and architecture issues in data processing framework components.
• Interacting with various internal and external stakeholders including presale leads and project managers.
• Performance tuning of Cloudera/Hortonworks big data platforms.
• Engaging third-party software support teams for production non-functional issues.
• Performing capacity and implementation design planning for Data Center technical components.
• Acting as a point of contact for architecture governance with stakeholders.
• Establishing build, design, and operate models for HA, DR, security, and scalability for data pipelines.
• Reviewing new technologies in Data/CI/CD domain and integrating new practices into projects.
• Collaborating with software engineers and architects to refine product structure and align with business needs.
• Supporting and leading architectural decisions across product lines.
• Researching and proposing improvements in processes and tools to ensure effective application of corporate standards.
• Understanding customer context while making technical decisions and providing inputs to development teams.

Requirements

• 10+ years of experience in software engineering and proven experience in software design and application architecture.
• Extensive background in building complex applications considering various technical factors.
• Proven experience in designing and operating high-volume data solutions from design to production.
• Strong experience with Cloudera/Hortonworks big data platforms.
• Demonstrated deep technical domain expertise in data management services and big data technologies.
• Experience in presenting ideas and influencing consensus in group settings.
• Customer-facing experience relevant to the role.

Nice-to-haves

• Experience with production performance and capacity analysis.
• Experience in data science (AI/ML) and self-service BI.
• Familiarity with BI platform migrations and DevOps practices.

Benefits

• Hybrid work model (3 days onsite, 2 days remote)
• Opportunity to work with cutting-edge technologies
• Professional development opportunities