Cloud Data Engineer

$85,800 - $209,100/Yr

Cgi Technologies And Solutions - Lafayette, LA

posted 4 months ago

Full-time - Mid Level
Lafayette, LA
Professional, Scientific, and Technical Services

About the position

CGI is seeking a Cloud Data Engineer who can bring in expertise and industry standard methodologies to define better development. The member will get an opportunity to work with a highly skilled team on the latest technologies, helping to shape their career with matured agile project delivery and sophisticated tech stack processes. The objective of this position is to work with business and technical experts to implement software engineering best practices that promote the highest reusability across the US and globally. The individual must possess superb analytical and technical skills coupled with the ability to drive project deliverables. The individual will be expected to participate in collaborative concept definition, architectural refinement, software design, and realization of products that support the strategic technology needs of the organization. A full stack engineer is someone with a breadth of knowledge in computer science, a problem-solving mentality, and a desire to learn. This person should be comfortable working within a technical capacity across many sectors, including core development on platform, data processing, and report generation. This role can be performed from Lafayette, LA, Bloomfield, CT, Nashville, TN, and Plano, TX in a hybrid model.

Responsibilities

  • Drive automation pyramid and integrate with CI/CD tools for continuous validation.
  • Drive the mentality of building well-architected applications for Cloud.
  • Identify code defects and work with other developers to address quality issues in product code.
  • Find bottlenecks and thresholds in existing code through the use of automation tools.
  • Continue education and improve code quality.
  • Migrate On-Premise solutions to cloud including Teradata Vantage.
  • Develop data pipelines to integrate with enterprise data streams - Cloud and on-premise.
  • Collaborate on architecture decisions and develop solutions in AWS, including Python, Databricks, Redshift, elastic search, DynamoDB, Lambda, Kinesis, Glue, and AI/ML tools.
  • Create Proof of Concepts, innovate, and integrate cloud-based software in a continuous delivery environment.

Requirements

  • 8+ years of diverse technology experience with a minimum of 6 years in software development.
  • 6+ years of experience with AWS capabilities - Databricks, DynamoDB, Lambda, Redshift, elastic search.
  • 6+ years of experience with API and streaming technologies.
  • 6+ years of software development experience with Python, PySpark, Apache Spark, and Kafka.
  • Strong knowledge of data integration (e.g., streaming, batch, error, and replay) and data analysis techniques.
  • 6+ years of experience with GitHub, Jenkins, and Terraform, experience with Teradata (Vantage) or any RDBMS system/ETL tools.
  • Good experience in designing and developing data pipelines for data ingestion and transformation using Spark.
  • Excellent troubleshooting skills for performance and data skew issues.
  • Deep knowledge in partitioning and bucketing concepts of data ingestion.
  • Working knowledge on the implementation of data lake ETL using AWS Glue, Databricks, etc.
  • Proficiency in SQL, relational and non-relational databases, query optimization, and data modeling.
  • Experience with source code control systems like GitLab.
  • Experience with large scale distributed relational and NoSQL database systems.
  • Expertise in designing technical solutions using object-oriented design concepts.
  • Provide recommendations and design optimal configurations for large-scale deployments.

Nice-to-haves

  • Experience in Healthcare, Teradata Customer Journey, Data & Analytics.

Benefits

  • Competitive base salaries
  • Eligibility to participate in an attractive Share Purchase Plan (SPP) with company matching contributions
  • 401(k) Plan and Profit Participation for eligible members
  • Generous holidays, vacation, and sick leave plans
  • Comprehensive insurance plans including medical, dental, vision, life, and disability
  • Back-up child care
  • Pet insurance
  • Member Assistance Program
  • 529 college savings program
  • Personal financial management tool
  • Lifestyle management programs
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service