Data Engineer III

Belcan - Seattle, WA

Full-time - Mid Level

Seattle, WA

Professional, Scientific, and Technical Services

About the position

As a Data Engineer on the AWS Marketing Insights team at Belcan, you will play a pivotal role in designing, building, and maintaining robust data pipelines and infrastructure that drive data-driven insights. Your core responsibilities will include architecting scalable and fault-tolerant pipelines to extract, transform, and load data from various sources into data warehouses or lakes. You will leverage cutting-edge tools and technologies to implement ingestion, transformation, and integration processes, ensuring stringent data quality through validation, cleansing, and deduplication. In this role, you will design and implement high-performance, scalable, and cost-efficient data storage solutions. Utilizing CI/CD principles, you will automate infrastructure deployment and maintenance processes, ensuring a streamlined data ecosystem. Data modeling and engineering will be crucial, involving the design and implementation of optimized data models, development and maintenance of ETL processes, and collaboration with analysts and functional managers to understand data needs and provide tailored data structures. Ensuring data governance, security, and compliance will be paramount. You will implement robust policies and processes, enforce access controls, encryption, and auditing mechanisms, and collaborate cross-functionally to establish and maintain data governance standards. Continuous improvement and automation will be woven into your daily activities, as you continuously evaluate and optimize processes, pipelines, and infrastructure, implement automation and monitoring tools, and stay ahead of emerging data engineering technologies and trends.

Responsibilities

• Design, build, and maintain robust data pipelines and infrastructure.
• Architect scalable and fault-tolerant pipelines to extract, transform, and load data.
• Implement ingestion, transformation, and integration processes ensuring data quality.
• Design and implement high-performance, scalable, and cost-efficient data storage solutions.
• Automate infrastructure deployment and maintenance processes using CI/CD principles.
• Develop and maintain ETL processes and optimized data models.
• Collaborate with analysts and functional managers to understand data needs.
• Implement data governance, security, and compliance policies and processes.
• Continuously evaluate and optimize processes, pipelines, and infrastructure.

Requirements

• 5+ years of data engineering, database engineering, business intelligence or business analytics experience.
• Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent.
• Knowledge of distributed systems as it pertains to data storage and computing.
• Knowledge of professional software engineering & best practices for full software development life cycle.
• Proficient in programming languages such as Python, Scala, or Java, and familiarity with SQL.
• Experience with data engineering tools and frameworks like Apache Spark, Apache Kafka, Apache Airflow, or similar.
• Knowledge of data warehousing concepts, dimensional modeling, and building ETL pipelines.
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration skills.

Nice-to-haves

• Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent.
• Experience with business intelligence and visualization software (e.g., Quicksight).
• Experience working with technical and non-technical internal customers for analytics and reporting.
• Experience building data environments with a high emphasis on data quality and security.