AI Inference Engineer QVAC (100% remote Worldwide)
Tether · Engineering · 4d ago
Anyone, anywhere in the world can apply.
Direct from the employer's own careers page
Who can apply
Read straight from the listing, so you know before you spend time on it.
Anyone, anywhere in the world can apply.
“AI Inference Engineer QVAC (100% remote Worldwide)”
The team works remotely from every corner of the world.
- Async-first
- The listing doesn't promise async-first working.
- Contractor / B2B
- No mention of hiring international contractors or invoicing.
- Global stipend
- No home office or equipment budget mentioned.
- Annual retreat
- No company-paid get-togethers mentioned.
Read from the listing automatically. Always confirm the details with the company before you accept an offer.
About the role
In this role, you will own the inference backbone behind QVAC's local AI stack: the C++ systems layer that ensures models run quickly, reliably, and predictably on user hardware without relying on cloud infrastructure. You will focus on runtime engineering, optimizing startup behavior, memory pressure, and throughput/latency balance across various hardware configurations. Working close to the metal with frameworks like llama.cpp and ggml, you will establish core abstractions enabling private, on-device AI experiences for next-generation peer-to-peer products.
What you'll do
- Deploy machine learning models to edge devices using frameworks such as llama.cpp and ggml
- Collaborate closely with researchers to assist in coding, training, and transitioning models to production
- Integrate cutting-edge AI and machine learning capabilities into existing products
- Optimize inference runtime for fast model loading, low memory consumption, and cross-hardware performance
What you bring
- Strong programming skills in C++
- Strong experience with llama.cpp and ggml inference engines deploying to specific GPU architectures
- Experience with GPU frameworks such as CUDA, Vulkan, Metal, or OpenCL
- Solid understanding of deep learning concepts and architectures including transformers, LLMs, and diffusion models
- Degree in Computer Science, AI, Machine Learning, or a related field with a track record in AI R&D
- Excellent English communication skills
About Tether
Tether is a global fintech leader pioneering digital finance and blockchain solutions, notably issuing the world's most trusted stablecoin, USDT. Beyond finance, Tether drives innovation across sustainable Bitcoin mining, peer-to-peer data sharing, and AI technologies.
View Tether profile & open roles →