Barbaricum Logo

Barbaricum

GenAI Subject Matter Expert (SME)

Posted 4 Days Ago
Be an Early Applicant
Remote
2 Locations
7-10
Senior level
Remote
2 Locations
7-10
Senior level
Lead technical benchmarking and model evaluation for Generative AI in DoD, focusing on RAG, model monitoring, and document analysis using AI frameworks.
The summary above was generated by AI

Barbaricum is a rapidly growing government contractor providing leading-edge support to federal customers, with a particular focus on Defense and National Security mission sets. We leverage more than 17 years of support to stakeholders across the federal government, with established and growing capabilities across Intelligence, Analytics, Engineering, Mission Support, and Communications disciplines. Founded in 2008, our mission is to transform the way our customers approach constantly changing and complex problem sets by bringing to bear the latest in technology and the highest caliber of talent.

Headquartered in Washington, DC's historic Dupont Circle neighborhood, Barbaricum also has a corporate presence in Tampa, FL, Bedford, IN, and Dayton, OH, with team members across the United States and around the world. As a leader in our space, we partner with firms in the private sector, academic institutions, and industry associations with a goal of continually building our expertise and capabilities for the benefit of our employees and the customers we support. Through all of this, we have built a vibrant corporate culture diverse in expertise and perspectives with a focus on collaboration and innovation. Our teams are at the frontier of the Nation's most complex and rewarding challenges. Join our team.

Barbaricum is seeking a Generative AI (GenAI) Subject Matter Expert (SME) to lead technical benchmarking, model evaluation, and best practices for implementing LLMs and AI-driven solutions in the DoD. This role focuses on retrieval-augmented generation (RAG), model performance monitoring, and AI-driven document analysis using AWS Bedrock, AWS Sagemaker, and other AI frameworks.

Responsibilities:

  • Lead technical research and benchmarking for GenAI and RAG implementations.
  • Develop model performance evaluation metrics to optimize AI-driven workflows.
  • Provide expert guidance on LLM integration for DoD applications.
  • Test, validate, and refine GenAI models, ensuring efficiency and reliability.
  • Recommend best practices for unstructured document and content analysis using AI.

Qualifications:

  • Must be a U.S. Citizen and reside within the United States.
  • AWS certifications highly preferred; AIML and SEC experience is a plus.
  • Bachelor’s degree plus 7+ years of experience, or Master’s degree plus 5+ years of experience in AI, Machine Learning, or Data Science.
  • Experience with LLMs, Generative AI, RAG, and AI-powered knowledge retrieval.
  • Strong expertise in AWS Bedrock, cloud AI services, and AI model benchmarking.
  • Proficiency in Python, SQL, and AI evaluation frameworks.

EEO Commitment

All qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, physical or mental disability, medical condition, genetic information, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law.

Top Skills

Aws Bedrock
Aws Sagemaker
Python
SQL

Similar Jobs

Senior level
Healthtech
The Associate Director will develop innovative statistical methods, provide consulting for projects, and mentor junior staff while collaborating across teams in biostatistics and data science.
Top Skills: Adaptive DesignsBayesian MethodsR
47-70
Senior level
Healthtech
The role involves developing and enhancing BI solutions, analyzing business needs, and mentoring team members while ensuring documentation standards are met.
Top Skills: Epic CaboodleEpic ClarityEpic CogitoPython
16 Days Ago
Remote
USA
Senior level
Senior level
Information Technology
The Senior Speech Scientist will develop grammar for IVR applications, act as a speech recognition expert, and support sales initiatives.
Top Skills: Amazon LexAudacityEcmascriptGenesys GvpGoogle VoiceIbm WatsonJavaJavaScriptLinuxNuance Dragon VoiceNuance License ManagerNuance RecognizerNuance Speech ServerNuance SpeechsuiteNuance VocalizerPerlPythonSirikitSoxWindows

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account