Senior Data Engineer (Only W2)

Net2Source - Dallas, TX

Full-time - Mid Level

Dallas, TX

Administrative and Support Services

About the position

As a part of the Product Engineering Services practice, we are looking for a talented Sr. Data Engineer to join our team in Dallas, TX. This role is crucial for contributing to practice initiatives and keeping current with the latest technology developments in the Cloud and Product Engineering space. The Sr. Data Engineer will be responsible for assembling large, complex sets of data that meet both non-functional and functional business requirements. This includes identifying, designing, and implementing internal process improvements, such as re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. The role also involves building the required infrastructure for optimal extraction, transformation, and loading (ETL) of data from various data sources using AWS and SQL technologies. The Sr. Data Engineer will work closely with stakeholders, including data, design, product, and application teams, to assist them with data-related technical issues and support their data infrastructure needs. This position requires building and optimizing data sets, big data pipelines, and architectures, as well as performing root cause analysis on external and internal processes and data to identify opportunities for improvement. Additionally, the Sr. Data Engineer will apply analytic skills associated with working on unstructured datasets and build processes that support data transformation, workload management, data structures, dependency, and metadata. The ideal candidate will have a demonstrated understanding and experience using various software and tools, including data tools like AWS Glue, NoSQL and SQL databases such as DynamoDB and Postgres, and object function/object-oriented scripting languages including NodeJS, Java, and Python.

Responsibilities

• Assemble large, complex sets of data that meet non-functional and functional business requirements.
• Identify, design, and implement internal process improvements including re-designing infrastructure for greater scalability.
• Optimize data delivery and automate manual processes.
• Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS and SQL technologies.
• Work with stakeholders including data, design, product, and application teams to assist them with data-related technical issues.
• Support data infrastructure needs while assisting with data-related technical issues.
• Build and optimize data sets, big data pipelines, and architectures.
• Perform root cause analysis on external and internal processes and data to identify opportunities for improvement.
• Apply analytic skills associated with working on unstructured datasets.
• Build processes that support data transformation, workload management, data structures, dependency, and metadata.

Requirements

• Experience in creating, configuring, and subscribing to APIs (Rest, SOAP XML).
• Ability to analyze structured and unstructured data from different sources based on project needs and demonstrate the analysis to the business for sign-off.
• Demonstrated understanding and experience using data tools like AWS Glue, NoSQL and SQL databases including DynamoDB and Postgres, and object function/object-oriented scripting languages including NodeJS, Java, and Python.
• Knowledge of Cloud Technologies.
• Excellent communication skills.
• Strong knowledge of and experience with reporting packages (Business Objects etc.), databases (SQL etc.), and programming (XML, Javascript, or ETL frameworks).
• Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
• Expert in writing database queries, analyzing output, and presenting findings.
• Experience working with OAuth, IAM User, Security Tokens.
• Excellent interpersonal, business communication, and writing skills.
• Detail-oriented and customer service focused.
• Experience with agile methodologies.
• Experience with Postman, Jira, Confluence.