Ghost
From company careers site
Member of Technical Staff - Inference
- Location
- San Francisco
- Work mode
- On-site
- Employment type
- Full-time
About the job
ABOUT GHOST
Ghost is a personal AI hardware company.
To realize the full benefit of what models will do for people, we believe an entirely new platform will be built around AI. Some devices will let your AI understand what is happening around you, others will enable you to get things done without navigating apps or menus.
As these systems become more capable and more personal, it matters who owns them. We’re building a future where that intelligence belongs to you, with an ecosystem of devices and software that gives you greater control over your time, attention, and the things you want to accomplish.
What you'll do
- Build and optimize the inference stack that runs personal AI models locally on Core.
- Improve latency, throughput, and memory efficiency across interactive requests and background agent workloads.
- Profile performance across the hardware and software stack, optimizing kernels, memory movement, and runtime execution.
- Build benchmarks that reflect real product workloads, including long contexts, concurrent agents, and sustained operation.
- Work closely with the hardware, post-training, and product teams.
Who you are
- Experience building or optimizing inference systems for language models.
- Strong systems programming skills in C++ or similar languages, alongside proficiency in Python.
- Familiarity with GPU architecture, memory management, and performance profiling.
- Experience with inference runtimes, quantization, or GPU kernel development using CUDA, Triton, or equivalent tools.
- Strong experimental judgment: you can identify bottlenecks and evaluate tradeoffs between speed, memory, power, and model quality.
- Ability to work on-site in San Francisco.
From Ghost's careers page (Ashby), checked 30 Oct 2026.
How to apply
- Select Apply on tryghost.ai. It opens Ghost's own application form in a new tab, run on Ashby.
- Fill in the form and upload your résumé there. Jobiwork never sees your application.
- Ghost will reply to you directly. No real employer asks you for money to apply.
Posted 15 Oct 2026 · checked 30 Oct 2026 · Report this job
