Data Architect

Pivotal Solutions - Washington, DC

Full-time - Mid Level

Remote - Washington, DC

Professional, Scientific, and Technical Services

About the position

The Data Architect position at Pivotal Solutions, Inc. is a remote role focused on designing and implementing robust ETL processes to meet client specifications. The role requires strong analytical skills, problem-solving abilities, and effective communication to navigate requirements and deliver high-quality data pipelines. The ideal candidate will have a solid understanding of cloud infrastructure and data warehousing techniques, along with hands-on experience in building data pipelines using various technologies.

Responsibilities

• Architect and design robust ETL processes using tools like Spark, Airflow, and AWS Glue.
• Analyze data to identify necessary pre-processing steps for automated ETL processes.
• Deliver data pipelines with quality and automated testing.
• Work through ambiguity in requirement documents and follow through to implementation independently.
• Communicate effectively with team members and stakeholders.

Requirements

• Bachelor's degree in computer science, information technology, or a related field.
• Extensive knowledge of coding languages used to build data pipelines, such as Java, Scala, and/or Python.
• Experience with Databricks or Spark.
• Hands-on experience building data pipelines in AWS using AWS Glue, Redshift, S3 buckets, and other relevant technologies.
• Proficiency in warehousing architecture techniques, including MOLAP, ROLAP, ODS, DM, and EDW.
• Proven work experience as an ETL developer.
• Experience using Source Code and Version Control systems like Git.
• Strong project management skills.
• Ability to analyze a company's big-picture data needs.
• Clear communication skills.
• Ability to troubleshoot and solve complex technical problems.

Nice-to-haves

• Desire to continually keep up with advancements in data best practices.