Data Engineer / Consultant

$80,000 - $120,000/Yr

Smartbridge - Houston, TX

Full-time - Mid Level

Houston, TX

Professional, Scientific, and Technical Services

About the position

The Data Engineer / Consultant at Smartbridge will play a crucial role in the architecture, design, and development of scalable data integration and engineering processes. This position involves working closely with clients and the consulting team to deliver high-quality data solutions that meet client goals and enhance business transformation through innovative data strategies.

Responsibilities

• Deliver consulting projects/work on-time, on-budget, and in a way that accomplishes client goals
• Develop and implement technical best practices for data ingestion, data quality, data cleansing, and other data integration/ETL/Engineering-related activities
• Maintain a multi-terabyte enterprise data warehouse with accompanying incremental data pipelines
• Build the infrastructure required for optimal extraction, transformation, and loading of data from various sources using SQL and modern cloud technologies
• Conduct or participate in meetings with owners of key system components to understand current data and systems environments
• Resolve source data issues and refine transformation rules
• Analyze source system data to assess transformation logic and data quality through data profiling
• Leverage data quality processes to assist with data cleansing requirements
• Work with technical and business representatives to determine strategies for handling data anomalies
• Design ETL processes and develop source-to-target data mappings, integration workflows, and load processes
• Develop, test, integrate, and deploy data pipelines using various tools and programming/scripting languages
• Provide technical documentation and other artifacts for data pipelines and solutions
• Identify problems, develop ideas, and propose solutions requiring analytical thinking
• Apply creative thinking to identify possible reporting solution alternatives
• Other duties assigned as needed

Requirements

• 3+ years hands-on experience with Azure Data Factory & Synapse
• Experience with Azure Databricks
• Experience building on-prem data warehousing solutions
• Experience with designing and developing ETL's, Data Marts, Star Schema's
• Experience with building data warehousing solutions in Azure
• Experience moving data from on-prem to cloud
• Experience designing a data warehouse solution using Synapse or Azure SQL DB
• Experience building pipelines using Synapse or Azure Data Factory
• Understanding of integration run times available in Azure
• Advanced working SQL knowledge and experience with relational databases
• Expert with scripting languages like Python, Pyspark, Scala

Nice-to-haves

• Microsoft Azure Cloud platform certifications

Benefits

• 100% Paid Healthcare Insurance
• Start accruing Paid Days Off from Day One
• Career Development
• Fitness Reimbursement
• Matching 401K Retirement Plan
• Mentoring Program
• Team Events