Data Engineer II

Idelic - Pittsburgh, PA

Full-time

Remote - Pittsburgh, PA

Publishing Industries

About the position

The Data Engineer II position at Idelic focuses on developing and managing the company's core data processing platform. This role involves building integrations with various third-party services and internal customers, ensuring the platform operates reliably and efficiently while making data accessible in a secure manner. The position emphasizes collaborative problem-solving, sophisticated design, and high-quality work within a remote work environment.

Responsibilities

• Develop software solutions according to technical and user specifications
• Communicate effectively and participate with team members in an agile environment
• Perform peer code reviews and ensure contributions are of a high quality
• Leverage build/deploy automation and implement unit tests to assure quality delivery of solutions
• Work on any task or help solve problems where needed.

Requirements

• Bachelor of Science in Computer Science
• Strong proficiency in Python or similar languages (PHP, TypeScript, or Swift)
• Experience with Linux based command line tools
• Experience writing unit, integration and end-to-end test code
• Familiarity with RESTful APIs
• Familiarity with code versioning tools such as Git, SVN, and Mercurial
• Willingness and ability to learn new software platforms as necessary
• Ability to understand business requirements and translate them into technical requirements
• Experience with SQL and RDBMS concepts (SQL Server, Oracle, MySQL, PostgreSQL, etc.)

Nice-to-haves

• Familiarity with Agile development practices
• Familiarity of different programming paradigms, such as functional or object oriented
• A knack for benchmarking and optimization
• Experience working with Amazon Web Services (AWS) such as S3, Glue, Athena, Lambda, EC2, RDS, Route 53
• Experience with Airflow for job orchestration
• Experience with data pipelines
• Experience with Scala, Google Go, and other programming languages
• Experience working in an entrepreneurial or enterprise environment