Grimco - Saint Louis, MO
posted 2 months ago
About the position
As a Senior Data Engineer at Grimco, you will play a crucial role in our dynamic data engineering team, where your contributions will directly impact our success. This position is not just about performing tasks; it's about being a vital part of our mission to leverage data for solving complex business problems. You will be responsible for designing, building, and maintaining our data infrastructure, ensuring that our data is prepared for advanced analytics. Your expertise will be essential in creating robust and scalable data pipelines that collect, process, and transform large datasets from various sources. You will also implement and maintain ETL processes to support data ingestion and integration, develop and manage data warehouses and data lakes, and monitor data pipelines to ensure data integrity and availability. In this role, you will be expected to perform data profiling and analysis to identify data quality issues and implement effective solutions. Staying updated with the latest trends and technologies in data engineering, machine learning, and big data will be crucial for your success. You will work in a collaborative environment, where your problem-solving skills and ability to communicate complex technical concepts to non-technical stakeholders will be highly valued. This position offers an exciting opportunity to shape the future of Grimco by contributing to our data-driven initiatives.
Responsibilities
- Design, develop, and optimize robust and scalable data pipelines to collect, process, and transform large datasets from various sources.
- Implement and maintain ETL (Extract, Transform, Load) processes to support data ingestion and integration.
- Develop and manage data warehouses, data lakes, and other storage solutions to ensure efficient data retrieval and analysis.
- Monitor and troubleshoot data pipelines to ensure data integrity, quality, and availability.
- Perform data profiling and analysis to identify data quality issues and implement solutions to address them.
- Stay updated with the latest trends and technologies in data engineering, machine learning, and big data.
Requirements
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- 5+ years of experience in data engineering, with a strong focus on data preparation for machine learning.
- Proficiency in programming languages such as Python and C#.
- Extensive experience with SQL and database technology (SQL Server, Azure SQL, DB2 on iSeries, JSON, ELK Stack).
- Extensive experience with Capture Data Changes (CDC) replication.
- Familiarity with cloud platforms (e.g., AWS, Microsoft Fabric, Snowflake) and their data services.
- Familiarity with SSAS.
- Strong understanding of ETL processes, data warehousing, and data modeling concepts.
- Knowledge of data governance, data quality, and data security best practices.
- Excellent problem-solving skills and the ability to work effectively in a fast-paced, collaborative environment.
- Strong communication and interpersonal skills, with the ability to convey complex technical concepts to non-technical stakeholders.
- Familiarity with data visualization tools (e.g., Pyramid Analytics, Power BI).
- Experience with real-time data processing and streaming technologies.
Benefits
- Base Salary & Commission
- Full medical, dental, and vision benefits available. Premiums have remained unchanged for more than 16 years.
- Short-Term/Long-Term Disability
- Paid Maternity/Paternity Leave
- Paid Holidays
- Vacation Accrual (PTO Rollover)
- Employee Referral Benefits
- Volunteer Time Off
- 401K with Profit Sharing, up to 6% of the employee's total compensation earnings.
