Sr. Data Engineer

$130,000 - $180,000/Yr

Shi International Ltd - Austin, TX

Full-time - Mid Level

Austin, TX

5,001-10,000 employees

Furniture, Home Furnishings, Electronics, and Appliance Retailers

About the position

We are seeking a highly skilled Senior Data Engineer to join our innovative team. This role is crucial in driving data infrastructure and analytics integration within our organization. The ideal candidate will have a strong background in data engineering, software development, and data science, with a passion for solving complex problems and building scalable systems. You will work on the development, deployment, and optimization of data pipelines, data lakes, and databases, working closely with machine learning engineers, software development engineers, and stakeholders. Your expertise in advanced data practices will enhance customer experience and business operations. Additionally, you will collaborate with business partners to explore innovation opportunities and shape innovative applications. This role demands in-depth knowledge of data engineering, business strategy, and change management, along with the ability to thrive in a multidisciplinary environment. The position requires reporting to the SHI Somerset, NJ, or SHI Austin, TX office as determined by management.

Responsibilities

• Lead initiatives to develop and execute a governance model for data infrastructure and analytics
• Design, develop, and implement data solutions, including data pipelines, data lakes, and databases
• Ensure familiarity with AWS, Azure, Google Cloud, and big data technologies
• Measure and communicate the impact of data initiatives on the business and drive continuous improvement
• Analyze data and translate recommendations into actionable items for end users
• Assess and monitor performance, ensuring systems remain compliant with standards and secure against cybersecurity threats
• Lead complex, data-driven projects impacting SHI's business
• Explore and execute analytical solutions for various problems
• Acquire, analyze, and act on complex data sets; create ETL jobs; explore, inspect, and clean data; engineer features
• Implement and enforce data normalization practices to ensure database efficiency and integrity
• Organize and lead meetings with stakeholders; collaborate with internal groups to achieve project goals
• Stay updated on data science, big data, and cloud developments
• Ensure data systems are scalable, reliable, and efficient; integrate data solutions with systems and platforms; optimize performance
• Document design specifications, processes, models, and systems for transparency and reproducibility

Requirements

• Bachelor's or Master's degree in Computer Science, Software Engineering, Information Systems, Engineering, Mathematics, or a related field
• Minimum of 5 years of experience in data engineering, with exposure to software engineering best practices
• 2 years of direct experience using technologies like AWS, Azure, Google Cloud, and big data technologies
• Demonstrated experience in developing and deploying data pipelines in production environments
• Deep understanding of data structures, algorithms, and software design principles
• Proficiency in programming languages such as Python, Java, or Scala
• Extensive experience with data engineering frameworks and libraries like Apache Spark, Hadoop, and Kafka
• Solid understanding of software engineering principles, including version control (Git), testing, and CI/CD pipelines
• Strong skills in data preprocessing, feature engineering, and data analysis using tools like Pandas and SQL
• Expertise in SQL and data modeling, including data normalization and database optimization techniques
• Proficiency with cloud platforms such as AWS, Azure, or GCP (Google Cloud Platform) for deploying and managing data solutions
• Expertise in designing and supporting data pipelines, data lakes, and databases
• Experience in analyzing business requirements, recommending, and designing technical solutions
• Ability to write detailed and concise technical and design specifications
• Excellent analytical and problem-solving skills, capable of handling complex projects and delivering effective solutions
• Proficient in system security best practices
• Adaptability to changing priorities; can conform to shifting priorities, demands, and timelines through analytical and problem-solving capabilities
• Strong ability to work independently or in a team-oriented, collaborative environment
• Ability to take initiative and prioritize tasks, manage time, problem prevention, and problem-solving skills

Nice-to-haves

• Strong knowledge of big data technologies, including their architectures, processing techniques, and applications
• Experience with containerization (Docker) and orchestration (Kubernetes)
• Familiarity with deep learning architectures and techniques
• Experience with system design and building large-scale distributed systems
• Knowledge of specific domains such as data warehousing, ETL processes, or real-time data processing
• Strong project management and leadership skills

Benefits

• Health, wellness, and financial benefits to offer peace of mind to you and your family
• Continuous professional growth and leadership opportunities
• World-class facilities and the technology you need to thrive - in our offices or yours