AI Inference Engineer Job at Pantera Capital, Palo Alto, CA

cUpHVWNjZTZ0VVducU5OYTUrQlpqMkdkcHc9PQ==
  • Pantera Capital
  • Palo Alto, CA

Job Description

Location San Francisco Employment Type Full time Location Type Hybrid Department AI We are looking for an AI Inference engineer to join our growing team. Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference. Responsibilities Develop APIs for AI inference that will be used by both internal and external customers Benchmark and address bottlenecks throughout our inference stack Improve the reliability and observability of our systems and respond to system outages Explore novel research and implement LLM inference optimizations Qualifications Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX) Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.) Understanding of GPU architectures or experience with GPU kernel programming using CUDA The cash compensation range for this role is $190,000 - $250,000. Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above. Equity: In addition to the base salary, equity may be part of the total compensation package. Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan. #J-18808-Ljbffr Pantera Capital

Job Tags

Full time

Similar Jobs

RUSH RIVER REMODELING

Door / Window Installer Job at RUSH RIVER REMODELING

 ...Job Description Job Description Rush River Remodeling is seeking a reliable and motivated Door & Window Installer to join our growing team. This position involves installing windows and doors in residential homes. No prior experience is requiredwe are willing to... 

JANI-CORE LLC

Part Time Janitorial Cleaner Job at JANI-CORE LLC

 ...daily. Follow health and safety guidelines to maintain a safe environment. Working Hours: ~7 days a week ~4 hours early morning shifts (specific times to be discussed) Compensation: ~$12 - $19 per hour, based on experience and performance... 

Law Offices Of Steven Heisler LLC

Law Clerk Job at Law Offices Of Steven Heisler LLC

 ...Job Description This is an excellent opportunity for current law school students and recent law school graduates who are interested...  ...knowledge from three seasoned trial attorneys. As a Law Clerk at The Law Offices of Steven H. Heisler, LLC you will provide overall... 

E-Solutions

Harvest - Grain Handler/ Elevator worker (US) Job at E-Solutions

 ...Description: $15/hr - We work 730a-430p m-f when not in harvest hours. There is always a potential for overtime and weekends though. Harvest hours vary depending on need. Once we begin harvest hours I usually run 2 split shifts on 730a-730p and one 10a-10p They will... 

Mortgage Bankers Field Services

Occupancy Field inspector Job at Mortgage Bankers Field Services

 ...Description Job Description COMPANY OVERVIEW Mortgage Bankers Field Services is a property inspection company serving the real...  ...We are able to provide property updates by hiring contractors/inspectors in numerous States to provide these updates. Our inspectors...