Sr Data Engineer

$140,000 - $160,000/Yr

Unclassified - Dallas, TX

Full-time - Mid Level

Dallas, TX

501-1,000 employees

About the position

As a Senior Data Engineer at Hitachi Digital Services, you will play a crucial role in our Product Engineering Services practice. This position involves assembling large and complex datasets that meet both functional and non-functional business requirements. You will be responsible for identifying, designing, and implementing internal process improvements, which includes redesigning infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Your expertise will be essential in building the necessary infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies. In this role, you will collaborate with various stakeholders, including data, design, product, and application teams, to assist them with data-related technical issues. You will also support their data infrastructure needs while ensuring that data sets, big data pipelines, and architectures are built and optimized effectively. Your analytical skills will be put to the test as you perform root cause analysis on both external and internal processes and data, identifying opportunities for improvement and answering critical questions. You will also be tasked with building processes that support data transformation, workload management, data structures, dependencies, and metadata. To succeed in this position, you will need to demonstrate a strong understanding and experience with data tools such as AWS Glue, NoSQL and SQL databases including DynamoDB and Postgres, as well as object function/object-oriented scripting languages like NodeJS, Java, and Python. Your ability to create, configure, and subscribe to APIs (REST, SOAP XML) will be vital, as will your experience in analyzing structured and unstructured data from various sources. Excellent communication skills, strong analytical abilities, and a detail-oriented approach are essential for this role, as is experience with agile methodologies and tools like Postman, Jira, and Confluence.

Responsibilities

• Assemble large, complex sets of data that meet non-functional and functional business requirements.
• Identify, design, and implement internal process improvements including redesigning infrastructure for greater scalability.
• Optimize data delivery and automate manual processes.
• Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS and SQL technologies.
• Work with stakeholders including data, design, product, and application teams to assist them with data-related technical issues.
• Build and optimize data sets, big data pipelines, and architectures.
• Perform root cause analysis on external and internal processes and data to identify opportunities for improvement.
• Apply analytic skills associated with working on unstructured datasets.
• Build processes that support data transformation, workload management, data structures, dependency, and metadata.

Requirements

• Experience in creating, configuring, and subscribing to APIs (REST, SOAP XML).
• Experience in analyzing structured and unstructured data from different sources based on project needs.
• Demonstrated understanding and experience using data tools like AWS Glue, NoSQL and SQL databases including DynamoDB and Postgres.
• Proficiency in object function/object-oriented scripting languages including NodeJS, Java, and Python.
• Knowledge of Cloud Technologies.
• Excellent communication skills.
• Strong knowledge of and experience with reporting packages (Business Objects etc.), databases (SQL etc.), and programming (XML, Javascript, or ETL frameworks).
• Strong analytical skills with attention to detail and accuracy.
• Expert in writing database queries, analyzing output, and presenting findings.
• Experience working with OAuth, IAM User, and Security Tokens.
• Excellent interpersonal, business communication, and writing skills.
• Detail-oriented and customer service focused.
• Experience with agile methodologies.
• Experience with Postman, Jira, and Confluence.

Benefits

• Industry-leading benefits and support for holistic health and wellbeing.
• Flexible arrangements that work for you, depending on role and location.
• Opportunities for autonomy, freedom, and ownership in your work.
• A sense of belonging and collaboration with talented colleagues.