Recorded Future - Somerville, MA
posted about 2 months ago
Full-time - Entry Level
Somerville, MA
Publishing Industries
About the position
As a Data Engineer I at Recorded Future, you will be part of a dynamic team focused on building reliable data pipelines that transform raw data into actionable analytics. This role is crucial for identifying and combating cyber security threats by leveraging data from various public web sources and structured data feeds.
Responsibilities
- Develop, productionalize, and maintain high volume data extraction via custom harvesters, APIs, and data stores.
- Create well monitored production data pipelines that convert raw data into organized and actionable information.
- Maintain and upgrade existing data flow production systems.
- Collaborate with senior engineers through design reviews, code reviews, pair programming, and other software engineering best practices.
Requirements
- 1+ years of Python experience, comfortable writing in Python and using it in personal projects or previous professional experiences.
- 1+ years of experience working with large datasets, adept at handling large, complex data structures.
- Experience transforming large datasets in Python and querying with modern datastores such as MongoDB and RedShift.
- Strong debugging skills.
- Desire to learn and grow in coding and understanding the impact of work on clients and the intelligence community.
