Two Six Technologies Logo

Two Six Technologies

AI/ML Data Pipeline Engineer

Posted Yesterday
Remote
Hiring Remotely in USA
82K-122K Annually
Mid level
Remote
Hiring Remotely in USA
82K-122K Annually
Mid level
Develop and enhance data storage and querying solutions for analysis, collaborate in Agile teams, and ensure security in development phases.
The summary above was generated by AI

At Two Six Technologies, we build, deploy, and implement innovative products that solve the world’s most complex challenges today. Through unrivaled collaboration and unwavering trust, we push the boundaries of what’s possible to empower our team and support our customers in building a safer global future.

AI/ML Data Pipeline Engineer

Would you like to use your data engineering skills to help policy makers, corporate leaders, and operators make sense of increasingly complex information spaces? Two Six Technologies provides Information Advantage to Government, Military, and private sector customers tasked with mission critical decision making. 

Our products collect and synthesize huge quantities of publicly available data in multiple languages, then serve that data to be easily queried by our expert analysts and used in machine learning analytics. As a data engineer you will work with product engineering teams, data scientists, DevOps, and architects, to apply best practices for data storage and retrieval in the design and implementation of new products, features, and capabilities. 

You are very comfortable with both SQL and NoSQL databases, in particular the Elasticsearch stack, which is at the heart of our high-volume, data-driven products and capabilities. Having previous experience with data in multiple languages is a huge plus! You have experience working with AWS, Linux, and ideally with technologies like Docker and Kubernetes. You also have worked as a member of remote engineering teams in Agile software development environments. You should be excited about organizing data in a way that supports the latest in Natural Language Processing analytics, including generative AI.

Most importantly you share our passion for applying technology to solve hard problems and finding innovative ways to derive insights from high-volume data. 

Responsibilities:

  • Developing and enhancing high volume data storage and querying solutions that enable analysis by both human experts and machine learning solutions
  • Operating in a collaborative, agile environment, with a focus on taking action and working closely with peers to enable team success
  • Creating proofs-of-concept and prototypes to quickly test ideas, as well as designing and building scalable, production-ready solutions
  • Considering security best practices at every phase of software development
  • Continuously learning and improving
  • Working within Agile software development methodologies and being an active part of our continuous improvement efforts
  • Working in a fully remote team with a diverse set of skills and experiences
  • Independently identifying and solving problems, and questioning assumptions in pursuit of the right solutions 
  • Actively participating in the peer code review process
  • Working closely with application engineers, mostly working in Python, to implement scalable solutions for loading, generating, aggregating, and analyzing data
  • Creating and executing both manual and automated testing

Qualifications:

  • Extensive experience with the full Elasticsearch stack, including indexing and search APIs, and Kibana, ideally with both locally hosted and Elastic hosted instances
  • Experience with SQL database technologies, ideally Postgres
  • Experience with AWS or similar cloud-based infrastructure
  • Experience with Python
  • Experience with the design, development, testing, and support of scalable, data-driven applications deployed to production SaaS environments
  • Experience working independently and as a part of an Agile team 

Optional Skills / Domain Experience

  • Experience with optimizing the processing, storage, and querying of data in multiple languages
  • Hands on experience managing the full Elastic stack, including deployment, infrastructure, security, and backup & recovery, is not required but definitely a plus
  • Elastic certification
  • AWS certification
  • Experience with data science and advanced analytics

Security Clearance:

Eligibility to obtain a government clearance if required/needed.

#LI-JS

#LI-JB1

Two Six Technologies is committed to providing competitive and comprehensive compensation packages that reflect the value we place on our employees and their contributions. We believe in rewarding skills, experience, and performance. Our offerings include but are not limited to, medical, dental, and vision insurance, life and disability insurance, retirement benefits, paid leave, tuition assistance and professional development.

The projected salary range listed for this position is annualized. This is a general guideline and not a guarantee of salary. Salary is one component of our total compensation package and the specific salary offered is determined by various factors, including, but not limited to education, experience, knowledge, skills, geographic location, as well as contract specific affordability and organizational requirements.

Salary Range
$81,500$122,400 USD

Looking for other great opportunities? Check out Two Six Technologies Opportunities for all our Company’s current openings! 

Ready to make the first move towards growing your career? If so, check out the Two Six Technologies Candidate Journey!  This will give you step-by-step directions on applying, what to expect during the application process, information about our rich benefits and perks along with our most frequently asked questions.  If you are undecided and would like to learn more about us and how we are contributing to essential missions, check out our  Two Six Technologies News  page!  We share information about the tech world around us and how we are making an impact!  Still have questions, no worries!  You can reach us at Contact Two Six Technologies. We are happy to connect and cover the information needed to assist you in reaching your next career milestone.

Two Six Technologies is an Equal Opportunity Employer and does not discriminate in employment opportunities or practices based on race (including traits historically associated with race, such as hair texture, hair type and protective hair styles (e.g., braids, twists, locs and twists)), color, religion, national origin, sex (including pregnancy, childbirth or related medical conditions and lactation), sexual orientation, gender identity or expression, age (40 and over), marital status, disability, genetic information, and protected veteran status or any other characteristic protected by applicable federal, state, or local law. 

If you are an individual with a disability and would like to request reasonable workplace accommodation for any part of our employment process, please send an email to [email protected]. Information provided will be kept confidential and used only to the extent required to provide needed reasonable accommodations.

Additionally, please be advised that this business uses E-Verify in its hiring practices.

By submitting the following application, I hereby certify that to the best of my knowledge, the information provided is true and accurate.

Top Skills

AWS
Docker
Elasticsearch
Kubernetes
Linux
NoSQL
Python
SQL

Similar Jobs

7 Minutes Ago
Remote or Hybrid
USA
140K-215K Annually
Senior level
140K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Manager - Observability, you will lead a team in building metrics and tracing platforms, participate in architecture development, and foster team collaboration.
Top Skills: AWSBashGCPGoOtelPrometheusPythonSentryTempoThanos
12 Minutes Ago
Easy Apply
Remote
U.S.
Easy Apply
76K-126K Annually
Mid level
76K-126K Annually
Mid level
Healthtech • Information Technology • Mobile • Productivity • Software • Analytics • Telehealth
The Brand Marketing Manager will oversee the Talent Solutions brand identity, create visual marketing materials, manage social media presence, and collaborate with teams to drive growth.
Top Skills: Adobe Creative SuiteCanvaFigmaGoogle SlidesPowerPoint
An Hour Ago
In-Office or Remote
Denver, CO, USA
75K-85K Annually
Mid level
75K-85K Annually
Mid level
Other • Software • Consulting
Lead the Customer Support and Professional Services team, ensuring high-quality service, coaching team members, and refining processes to enhance customer experience.
Top Skills: ExcelHubspotJIRAQgisSaaSZendesk

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account