Senior Software Engineer - Data Technologies (Multiple Openings)

$115,500 - $115,500/Yr

Kloudhive

Full-time - Senior

Professional, Scientific, and Technical Services

About the position

The Senior Software Engineer - Data Technologies role at Kloudhive LLC involves working with data technologies to design and implement data models, manage large datasets, and develop applications for data processing. The position requires expertise in SQL and Spark, with a focus on optimizing data ingestion and transformation processes. This role is critical for analyzing customer usage patterns and ensuring data integrity across various platforms.

Responsibilities

• Gather, analyze, and validate requirements through SME interactions.
• Design conceptual, logical, and physical data models.
• Write complex SQL queries and create datasets, linked services, and pipelines.
• Create data models adhering to PPDM and UDM standards using SQL data modeler/Infosphere Data Architect.
• Ingest source data from various relational and non-relational data sources into Azure Data Lake and Azure Synapse using ADF pipelines.
• Handle large datasets using Partitions, Spark in Memory capabilities, Broadcasts in Spark, effective & efficient Joins and Transformations during data ingestion process.
• Develop Spark applications using Spark-SQL in Data bricks for ETL to uncover insights into customer usage patterns.
• Optimize code for business requirements and convert large volumes of data into ready-to-use information.

Requirements

• Minimum of a Master's degree or equivalent in Computer Science, Computer Information Systems, IT-related engineering, or a related field.
• Experience with SQL and data modeling.
• Proficiency in Spark and data processing technologies.

Benefits

• Competitive salary of $115,500 per year.