Senior Software Engineer LLM Inferencing and AI Gateway

About this role:
Wells Fargo is seeking a Senior Software Engineer - LLM Inferencing & AI Gateway to join our Digital Technology - AI Capability Engineering team. In this role, you will design, build, and operate the GPU-based GenAI platform and the serving infrastructure for LLM/SLM workloads. Your work will span the full stack-from GPU cluster configuration and Run:AI/OpenShift AI orchestration to optimizing vLLM/Triton runtimes and hardening these systems for production use.
Key focus areas include H100/H200 GPU clusters, NVLink/NVSwitch, MIG, CUDA/NVML, GPU scheduling, and disaggregated inferencing patterns (prefill/decode). You will also drive observability best practices and deliver reliable, scalable model endpoints through an API Gateway-based production architecture.
In this role, you will:

• Lead complex Generative AI initiatives and deliverables within technical domain environments
• Contribute to large scale planning of strategies
• Design, code, test, debug, and document for projects and programs associated with technology domain, including upgrades and deployments
• Review moderately complex technical challenges that require an in-depth evaluation of technologies and procedures
• Resolve moderately complex issues and lead a team to meet existing client needs or potential new clients needs while leveraging solid understanding of the function, policies, procedures, or compliance requirements
• Collaborate and consult with peers, colleagues, and mid-level managers to resolve technical challenges and achieve goals
• Lead projects and act as an escalation point, provide guidance and direction to less experienced staff
• Engineer GPUs clusters and node pools; configure NVLink/NVSwitch, NVIDIA GPU Operator, MIG profiles, container runtime, and kernel/driver baselines for high-throughput LLM/SLM workloads.

Required Qualifications:

• 4+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education

Desired Qualifications:

• 1+ years of experience with GPU Inference including NVIDIA CUDA, cuDNN, NVLink/NVSwitch, MIG, NIXL, GPU profiling, and performance tuning on H100/H200 architectures
• 1+ years of experience with GPU orchestration platforms, such as RunAI (collections, queues, quotas, preemption, fair-share scheduling), OpenShift AI (RHOAI), and cluster administration on OCP or GKE
• 1+ years of experience with LLM/SLM serving frameworks, including vLLM, Triton, TensorRT-LLM/MII, KV-cache optimization strategies, and FP8/INT4 quantization techniques (AWQ/GPTQ)
• 1+ years of experience working with LLM API gateways, including OAuth2/mTLS authentication, rate-limiting and quota management, OpenAPI/SDK integration, SLAs, and versioning/deprecation practices
• 2+ years of experience in Generative AI engineering, including LLM/SLM operations, fine-tuning, evaluation pipelines, and developing model-specific performance optimization recipes
• 4+ years of experience in Python, including scripting, automation, and model/inference-related development

Job Expectations:

• Hybrid onsite at required locations
• No visa sponsorship available
• No relocation assistance for this position

Pay Range
Reflected is the base pay range offered for this position. Pay may vary depending on factors including but not limited to demonstrated examples of prior performance, skills, experience, or work location. Employees may also be eligible for incentive opportunities.
$100,000.00 - $196,000.00
Benefits
Wells Fargo provides eligible employees with a comprehensive set of benefits, many of which are listed below. Visit Benefits - Wells Fargo Jobs for an overview of the following benefit plans and programs offered to employees.

• Health benefits
• 401(k) Plan
• Paid time off
• Disability benefits
• Life insurance, critical illness insurance, and accident insurance
• Parental leave
• Critical caregiving leave
• Discounts and savings
• Commuter benefits
• Tuition reimbursement
• Scholarships for dependent children
• Adoption reimbursement

Posting End Date:
26 Jan 2026
* Job posting may come down early due to volume of applicants.
We Value Equal Opportunity
Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.
Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements.
Applicants with Disabilities
To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo .
Drug and Alcohol Policy
Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy to learn more.
Wells Fargo Recruitment and Hiring Requirements:
a. Third-Party recordings are prohibited unless authorized by Wells Fargo.
b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.