Recorded Future Logo

Recorded Future

Senior Data Engineer

Reposted 2 Days Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
The Senior Data Engineer will develop and maintain data pipelines from dark web sources, ensure data reliability, and improve analytics processes, directly supporting cybersecurity efforts.
The summary above was generated by AI

With 1,000 intelligence professionals, over $300M in sales, and serving over 1,900 clients worldwide, Recorded Future is the world’s most advanced, and largest, intelligence company!

Senior Data Engineer:

Recorded Future collects intelligence from many sources on the Dark Web. This data collection includes terabytes of data dumps that are shared and trafficked in the underground, nefarious dark web forums, markets for stolen goods, and most notably — ransomware sites. 

The Ransomware squad on the Dark Web team builds the data collection and analytics that transform this mass of raw data from ransomware blogs into structured intelligence that our customers use to defend their people and networks. 

The Senior Data Engineer will work on producing a constant stream of fresh, high-fidelity analytics derived from unreliable dark web and underground data sources that enable clients to track threat actors and take security actions. Your contribution will directly impact the success of the Dark Web team’s mission: to secure the world with intelligence by casting a light upon the dark web

What You'll Do:   
  • Build, maintain, monitor and Collect data from hard-to-reach dark web sites and ransomware blogs.
  • Own the reliability of the automatic processing of this structured raw data. Investigate and resolve data processing problems by improving our data processing code so it will automatically handle similar scenarios in the future.
  • Maintain and improve our data ingestion pipeline that processes and indexes metadata from large files. This includes analytic-generation services that use NLP to extract content with the highest security value.
  • Lead by example when architecting, collaborating and delivering new and improved solutions.
What You'll Bring :
  • 5+ years experience with Python working in a professional software engineering environment that involves thorough code testing and review processes
  • Strong problem solving capabilities and experience troubleshooting data issues within your own processes and those of your peers.
  • 5+ years experience maintaining production-ready, efficient data engineering pipelines and systems with extensive monitoring to accommodate complex data ingestion problems
  • Very flexible and outcome-oriented. Comfortable in a work environment where urgent issues arise often, and where quickly resolving issues has immediate security value for our end customers
  • A solid understanding of cybersecurity, along with an interest in analyzing dark web activities related to computer and network security.
  • Experience with NLP, as well as MongoDB, ElasticSearch, and AWS cloud services is highly desirable.

The base salary range for this full-time position is $107,000 - $145,000. Our salary ranges are determined by role, level, and location. The range displayed reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by state, work location and additional factors, including job-related skills, experience, and relevant education or training. This position may be eligible for incentive compensation, equity, and medical, dental, vision, life insurance and 401K. Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.

#LI-Remote

Why should you join Recorded Future?
Recorded Future employees (or “Futurists”), represent over 40 nationalities and embody our core values of having high standards, practicing inclusion, and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.8-star user rating from Gartner and more than 45 of the Fortune 100 companies as clients.

Want more info? 
Blog & Podcast: Learn everything you want to know (and maybe some things you’d rather not know) about the world of cyber threat intelligence
Linkedin, Instagram & Twitter: What’s happening at Recorded Future
The Record: The Record is a cybersecurity news publication that explores the untold stories in this rapidly changing field
Timeline: History of Recorded Future
Recognition: Check out our awards and announcements

We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences, backgrounds and lifestyles.  By ensuring all feel included and respected for being unique and bringing their whole selves to work, Recorded Future is made a better place every day.
If you need any accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to our recruiting team at [email protected] 

Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race, religion, color, national origin, gender including pregnancy, sexual orientation, gender identity, age, marital status, veteran status, disability or any other characteristic protected by law.
Recorded Future will not discharge, discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of the employee or applicant or another employee or applicant.

Recorded Future does not administer a lie detector test as a condition of employment or continued employment. This is in compliance with the law of the Commonwealth of Massachusetts, and in alignment with our hiring practices across all jurisdictions.

Notice to Agency and Search Firm Representatives:
Recorded Future will not accept unsolicited resumes from any source other than directly from a candidate. Any unsolicited resumes sent to Recorded Future, including those sent to our employees or through our website, will become the property of Recorded Future. Recorded Future will not be liable for any fees related to unsolicited resumes.

Agencies must have a valid written agreement in place with Recorded Future's recruitment team and must receive written authorization before submitting resumes. Submissions made without such agreements and authorization will not be accepted and no fees will be paid.

Top Skills

AWS
Elasticsearch
MongoDB
Nlp
Python

Similar Jobs

4 Days Ago
Remote or Hybrid
United States
60K-160K Annually
Mid level
60K-160K Annually
Mid level
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
The Data Engineer will design and implement data pipelines, manage Looker, ensure efficient ETL processes, and collaborate with teams to deliver scalable data solutions.
Top Skills: BashBigQueryCi/CdDataflowGCPGitHelmKubernetesLookerPub/SubPythonSQLTerraform
6 Days Ago
Remote
USA
Senior level
Senior level
Edtech • Social Impact • Software
The Senior Data Engineer role involves designing Snowflake data models, automating data processes, and ensuring reliable data sync while collaborating with BI and Product Analytics teams.
Top Skills: DbtSalesforceSnowflakeSQLTableau
12 Days Ago
Remote
USA
Senior level
Senior level
Software
The Senior Data Engineer will build and maintain analytics infrastructure, develop ETL processes, integrate data sources, mentor team members, and optimize data architecture.
Top Skills: AirflowAWSCi/CdCloudFormationKafkaPysparkPythonRedshiftSparkSQLTerraform

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account