Sr Lead Big Data Developer

$111,480 - $148,630/Yr

Lumen Technologies - Hartford, CT

Full-time - Senior

Hartford, CT

Telecommunications

About the position

The Senior Lead Big Data Developer at Lumen is responsible for leading the development of software solutions that identify and disrupt malicious threats on the Internet. This role involves working with large-scale systems and cutting-edge technologies to create, implement, and integrate complex big data solutions. The position requires collaboration with various stakeholders to translate business requirements into effective data solutions, while also mentoring junior developers and exploring new technologies to enhance threat detection capabilities.

Responsibilities

• Provide technical direction in the creation, implementation, and integration of complex big data solutions
• Collaborate and translate business requirements into implementation design and participate in the design, evaluation, and selection of best software solutions to achieve business objectives
• Design, develop, test, and deploy scalable and reliable data pipelines using technologies like Spark, Kafka, Hadoop, and other big data technologies
• Extract, transform, and load data from various sources and formats, such as relational databases, APIs, JSON, XML, CSV, etc.
• Perform data quality checks and validations, and handle data anomalies and issues
• Collaborate with other developers, data engineers, data analysts, and business stakeholders to understand data requirements and deliver data solutions
• Develop scalable systems that enable real-time validation of identified resources
• Mentor junior developers and engineers on the team and champion industry best practices
• Explore, evaluate and conduct PoC to determine new technology solutions that would improve our ability to detect newer threats or add efficiency to current processes

Requirements

• Master's or Bachelor's degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience
• Demonstrated experience in developing and working with big data technologies, such as Spark, Kafka, Hadoop, Hive, etc.
• Proficient in programming languages, such as Python, Java, Scala, or SQL
• Strong analytical and problem-solving skills, and attention to detail
• Good communication and teamwork skills, and ability to work independently and proactively
• Eager to learn new skills and technologies, and willing to take on challenges

Benefits

• Health insurance
• Life insurance
• Voluntary lifestyle benefits
• Short-term incentives
• Sales compensation
• Comprehensive benefits package that enhances physical, mental, emotional, and financial wellbeing