Martian Learning Logo Martian Learning
⏩ Martian Learning Logo
@

ML Engineer

πŸ’° $270,000 - $350,000 πŸ“… 10/15/2023

Apply

Backend/API Engineer at LLM Company

πŸ’° $180,000 - $250,000 πŸ“… 10/16/2023

Apply

Job Description

**About Martian:**

* Martian is doing for LLMs what Google did for websites. In the early internet, the number of websites was exploding and it was hard to figure out what website you should use for what task. Google fixed that problem by building a search engine that aggregated websites across the internet. A similar problem exists in AI today; the number of models is exploding and it's hard to figure out what model you should use for what task. Martian fixes that problem through a model router: You give us your prompt, we run it on the best model in real time.
* We can do this because we've learned how to predict the performance of a model without running it. That lets us find a model which can complete your request with the highest performance and lowest cost. The value proposition is simple: stop worrying about AI, start focusing on product.

### \- That idea -- making it so that people can stop worrying about AI -- is
the core of what we do. Model-routing is just the first tool we're building to
help understand the way in which models behave. By pioneering techniques like
this, we want to solve the most fundamental problem in AI: understanding why
models behave the way they do, and creating guarantees they'll behave the way
we want.

**Please Apply Here:** <https://jobs.gusto.com/postings/martian-learning-ml-
engineer-09b7c147-a448-4908-a4fc-443d98dcced4>
(Applications on Wellfound are not considered)

**About the role:**

Building a good model-router is technically challenging. It requires training
reward models from human feedback, developing more effective routing models,
speeding up model inference, reducing model costs, and hosting models in a
production-ready way. We're looking for someone to take on those challenges
with Martian.

**In this role you will:**

* Work alongside the founders to develop model-routing technology and bring it into production.
* Introduce new techniques, tools, and architecture that improve the performance, latency, throughput, and efficiency of our deployed models.

**You 'll thrive in this role if you:**

* Have an understanding of modern ML architectures and an intuition for how to optimize their performance, particularly for inference.
* Have trained reward models from human or AI feedback.
* Own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done.
* Have at least 3 years of professional software engineering experience (particularly in an ML Engineering role) or equivalent.
* Are self-directed and enjoy figuring out the most important problem to work on.
* Have a good intuition for when off-the-shelf solutions will work, and build tools to accelerate your own workflow quickly if they won’t.
* Are familiar with the following skills and stack
* Distributed training
* PyTorch Lightning
* Deepspeed

**The salary band on Wellfound is total compensation, exact equity amounts
vary depending on circumstance.**

Martian Learning focuses on Artificial Intelligence. Their company has offices
in San Francisco. They have a small team that's between 1-10 employees.

You can view their website at <https://withmartian.com>