Two Six Technologies Logo

Two Six Technologies

AI/ML Data Pipeline Engineer

Posted 19 Days Ago
Remote
Hiring Remotely in USA
130K-175K Annually
Mid level
Remote
Hiring Remotely in USA
130K-175K Annually
Mid level
Develop and enhance data storage solutions for analysis by experts and machine learning. Collaborate in an Agile environment, create proofs of concept, and ensure security best practices. Engage with application engineers to implement scalable solutions and conduct testing.
The summary above was generated by AI

At Two Six Technologies, we build, deploy, and implement innovative products that solve the world’s most complex challenges today. Through unrivaled collaboration and unwavering trust, we push the boundaries of what’s possible to empower our team and support our customers in building a safer global future.

Data Engineer

Would you like to use your data engineering skills to help policy makers, corporate leaders, and operators make sense of increasingly complex information spaces? Two Six Technologies provides Information Advantage to Government, Military, and private sector customers tasked with mission critical decision making. 

Our products collect and synthesize huge quantities of publicly available data in multiple languages, then serve that data to be easily queried by our expert analysts and used in machine learning analytics. As a data engineer you will work with product engineering teams, data scientists, devops, and architects, to apply best practices for data storage and retrieval in the design and implementation of new products, features, and capabilities. 

You are very comfortable with both SQL and noSQL databases, in particular the Elasticsearch stack, which is at the heart of our high-volume, data-driven products and capabilities. Having previous experience with data in multiple languages is a huge plus! You have experience working with AWS, Linux, and ideally with technologies like Docker and Kubernetes. You also have worked as a member of remote engineering teams in Agile software development environments. You should be excited about organizing data in a way that supports the latest in Natural Language Processing analytics, including generative AI.

Most importantly you share our passion for applying technology to solve hard problems and finding innovative ways to derive insights from high-volume data. 

Responsibilities:
  • Developing and enhancing high volume data storage and querying solutions that enable analysis by both human experts and machine learning solutions
  • Operating in a collaborative, agile environment, with a focus on taking action and working closely with peers to enable team success
  • Creating proofs-of-concept and prototypes to quickly test ideas, as well as designing and building scalable, production-ready solutions
  • Considering security best practices at every phase of software development
  • Continuously learning and improving
  • Working within Agile software development methodologies and being an active part of our continuous improvement efforts
  • Working in a fully remote team with a diverse set of skills and experiences
  • Independently identifying and solving problems, and questioning assumptions in pursuit of the right solutions 
  • Actively participating in the peer code review process
  • Working closely with application engineers, mostly working in Python, to implement scalable solutions for loading, generating, aggregating, and analyzing data
  • Creating and executing both manual and automated testing
Qualifications:
  • Extensive experience with the full Elasticsearch stack, including indexing and search APIs, and Kibana, ideally with both locally hosted and Elastic hosted instances
  • Experience with SQL database technologies, ideally Postgres
  • Experience with AWS or similar cloud-based infrastructure
  • Experience with Python
  • Experience with the design, development, testing, and support of scalable, data-driven applications deployed to production SaaS environments
  • Experience working independently and as a part of an Agile team 
Optional Skills / Domain Experience
  • Experience with optimizing the processing, storage, and querying of data in multiple languages
  • Hands on experience managing the full Elastic stack, including deployment, infrastructure, security, and backup & recovery, is not required but definitely a plus
  • Elastic certification
  • AWS certification
  • Experience with data science and advanced analytics

Two Six Technologies is committed to providing competitive and comprehensive compensation packages that reflect the value we place on our employees and their contributions. We believe in rewarding skills, experience, and performance. Our offerings include but are not limited to, medical, dental, and vision insurance, life and disability insurance, retirement benefits, paid leave, tuition assistance and professional development.

The projected salary range listed for this position is annualized. This is a general guideline and not a guarantee of salary. Salary is one component of our total compensation package and the specific salary offered is determined by various factors, including, but not limited to education, experience, knowledge, skills, geographic location, as well as contract specific affordability and organizational requirements.

Salary Range
$130,000$175,000 USD

Looking for other great opportunities? Check out Two Six Technologies Opportunities for all our Company’s current openings! 

Ready to make the first move towards growing your career? If so, check out the Two Six Technologies Candidate Journey!  This will give you step-by-step directions on applying, what to expect during the application process, information about our rich benefits and perks along with our most frequently asked questions.  If you are undecided and would like to learn more about us and how we are contributing to essential missions, check out our  Two Six Technologies News  page!  We share information about the tech world around us and how we are making an impact!  Still have questions, no worries!  You can reach us at Contact Two Six Technologies. We are happy to connect and cover the information needed to assist you in reaching your next career milestone.

Two Six Technologies is an Equal Opportunity Employer and does not discriminate in employment opportunities or practices based on race (including traits historically associated with race, such as hair texture, hair type and protective hair styles (e.g., braids, twists, locs and twists)), color, religion, national origin, sex (including pregnancy, childbirth or related medical conditions and lactation), sexual orientation, gender identity or expression, age (40 and over), marital status, disability, genetic information, and protected veteran status or any other characteristic protected by applicable federal, state, or local law. 

If you are an individual with a disability and would like to request reasonable workplace accommodation for any part of our employment process, please send an email to [email protected]. Information provided will be kept confidential and used only to the extent required to provide needed reasonable accommodations.

Additionally, please be advised that this business uses E-Verify in its hiring practices.

By submitting the following application, I hereby certify that to the best of my knowledge, the information provided is true and accurate.

Top Skills

AWS
Docker
Elasticsearch
Kubernetes
Linux
NoSQL
Python
SQL

Similar Jobs

6 Hours Ago
Remote or Hybrid
Santa Clara, CA, USA
159K-278K Annually
Senior level
159K-278K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
As a Staff DevOps Engineer, you will support, deploy, and maintain Big Data infrastructure, manage containerized applications, automate CI/CD pipelines, and collaborate with various teams to resolve issues in a 24x7 production environment.
Top Skills: AnsibleBashBig DataCloudera Data PlatformDockerFlinkGitGrafanaHadoopHbaseHdfsHiveImpalaJenkinsKafkaKubernetesKuduMariadbPostgresPrometheusPythonRabbitMQRedisSparkSQLVictoriametricsYarn
6 Hours Ago
Remote or Hybrid
Santa Clara, CA, USA
125K-213K Annually
Senior level
125K-213K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Senior Network Operations Engineer operates and maintains cloud network infrastructure, resolves network issues, and drives automation for deployment across large-scale environments. Responsibilities include monitoring, troubleshooting, and collaborating with various teams to enhance network performance and reliability.
Top Skills: AnsibleAWSAzureBashDockerF5GCPGitlabGrafanaKubernetesLinuxNginxPrometheusPythonSplunkTerraform
12 Hours Ago
Easy Apply
Remote or Hybrid
7 Locations
Easy Apply
150K-253K Annually
Senior level
150K-253K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Senior Software Engineer II will design and deliver AI-powered products, collaborate with teams, and ensure system reliability within a fullstack environment.
Top Skills: GoGraphQLMySQLReactTypescript

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account