SR Data Engineer

Global Soft Systems - Hoboken, NJ

Full-time - Mid Level

Hoboken, NJ

Professional, Scientific, and Technical Services

About the position

The Senior Data Engineer role involves designing and implementing data architectures and solutions using various technologies. This position requires a strong background in SQL, Python, and cloud services, particularly Google Cloud Platform, to manage and process large datasets effectively. The role is hybrid, requiring two days onsite, and is offered as a six-month contract with a high possibility of extension.

Responsibilities

• Design and implement data architectures and solutions.
• Query and manage large datasets using SQL.
• Develop data processing and automation scripts in Python.
• Utilize Pyspark for data processing tasks.
• Create visualizations and reports using Tableau.
• Work with Google Cloud Platform services such as BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
• Ensure best practices in ETL/ELT processes are followed.
• Solve complex data problems and implement effective solutions.
• Communicate technical information to non-technical stakeholders.

Requirements

• Bachelor's degree in Computer Science or related field or equivalent combination of industry-related professional experience and education.
• Proficiency in SQL for querying and managing large datasets.
• Strong programming skills in Python for data processing and automation.
• Experience with Pyspark for data processing.
• Familiarity with Tableau for data visualization.
• Experience with Google Cloud Platform services such as BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
• Expertise in data modeling and designing data architectures.
• Solid understanding of ETL/ELT processes and best practices.
• Demonstrated problem-solving skills in tackling complex data issues.
• Good verbal and written communication skills.

Nice-to-haves

• Experience with other cloud platforms (e.g. Azure).
• Familiarity with data visualization tools (e.g., Looker, Power BI).