Wist Labs Logo Wist Labs
Wist Labs Logo
@

Founding Machine Learning Engineer - Computer Vision, AR/VR

💰 $100,000 - $170 🌍 San Jose, San Francisco Bay Area 📅 08/16/2024

Apply

Job Description

### **About Wist Labs**

**We are redefining the way people capture, share, and relive memories.**

At Wist Labs, we’re building a platform that lets you actually step inside
your memories. To a user, they “just take a video” and then can walk inside
that replayable, immersive moment again. We’re shipping a private beta across
iOS, Quest, and Vision Pro. We’ve gone viral a few times. Even in our early
days, our app has deep emotional resonance, bringing some to tears.

See our website for a glimpse into what we’re building:
<https://wistlabs.com/>.

Wist Labs is backed by great investors including Long Journey Ventures, The
Pitch, Pareto, Hollywood leaders, and other founders. The founders of Wist
Labs made their careers creating impactful consumer experiences at Samsung,
Wells Fargo, and their own startups. We’re a small, dedicated, experienced
team.

Join us and transform the way we capture, experience, and share the moments
that matter most!

### **Who We’re Looking For**

We are seeking an experienced **Founding Machine Learning Engineer** to lead
the development of our processing pipeline, which is key to transforming user-
captured video into vibrant, replayable, 3D experiences. Our pipeline is the
foundation for our larger vision.

As a critical member of our early team, you will:

* **Architect, develop, and deploy our processing pipeline** , starting with integrating and fine-tuning open-source models and classical CV techniques to enhance the quality of our immersive memories. You will build on top of our current implementation.
* **Focus on tasks such as** data fusion, depth estimation, pose refinement, segmentation, and handling various media types to improve user captures.
* **Drive our 2D to 3D upconversion feature** , building on the current implementation and eventually developing custom models as we grow.
* **Balance short-term prototyping with long-term problem-solving** , ensuring we can quickly iterate on product ideas while also tackling complex technical challenges.
* **Collaborate closely with the team** to ship our app, ensuring high performance, reliability, and a magical user experience.

You default to action. You are able to evaluate work on both immediate and
medium-term timelines. You know solving a user problem with something that
doesn’t scale is more important than scaling something with low value. You
will use your unique perspective to find critical insights and opportunities.

### **Qualifications**

### **Minimum Qualifications**

1. **Extensive industry experience in machine learning engineering** (3+ years), with a focus on training, fine tuning, deploying, and connecting models in production environments, including managing cloud-based ML workflows.
2. **Broad experience with classical and ML-based computer vision techniques** , including depth estimation, 3D reconstruction, pose estimation, inpainting, and diffusion, especially in video processing contexts.
3. **Proficiency in Python and ML frameworks** such as PyTorch, or similar, with experience in integrating and fine-tuning existing models.
4. **Strong foundation in 3D mathematics and linear algebra** , with practical experience in vectorized math operations.
5. **Bachelor’s degree or higher in a relevant field** (e.g., CS, ML, CV), with substantial industry experience.
6. **Strong desire to build and scale a startup** from the early days.

### **Bonus Qualifications**

1. **Experience leading ML pipelines for video and reconstruction** , with a focus on tuning for real-time or near real-time performance.
2. **Background in sensor fusion, geometry processing, 3D reconstruction (NeRFs, splats, photogrammetry), or signal processing** , with knowledge of their strengths and limitations.
3. **Experience procuring, preparing, and managing training data** , including preparing and generating synthetic data.
4. **Publication record** in relevant journals and conferences.
5. **Proficiency in additional relevant technologies/skillsets** : CUDA, CoreML and Apple’s ML frameworks, Swift, ARKit, AVFoundation, Metal, Firebase, Unity, image/video encoding, technical art, shaders, rendering, and augmented and virtual reality.

### **Compensation & Benefits**

* **Generous equity package** with the flexibility to choose the balance between cash and equity (base $100k to $170k depending on skillset, with equity up to 3.5%).
* **Comprehensive health insurance** , with 100% premium coverage including dependents.
* **Dental and vision insurance available** , with 50% premium coverage including dependents.
* **Hybrid WFH policy.** Our office is located in downtown San Jose, easily accessible by public transport (4m walk from VTA light rail, 16m walk from Diridon Station).
* **Additional perks** : free gym access, bike parking, coffee.

### **Process**

We are actively interviewing on a rolling basis. Our process includes: the
initial application, an introductory call with a founder, a skills and culture
interview, a take home assignment, and reference checks.

### **Wist Labs is an Equal Opportunity Employer**

Wist Labs thrives on diversity and is committed to creating an inclusive
environment for all employees. We believe that our success depends on building
a team with a wide range of perspectives and experiences.