tl;dr: high-impact opportunity for a strong software engineer aspiring for start-up leadership to design and build our unified API for application developers to build production-ready LLM apps

The Job:

We are looking for a growth-oriented, positive-minded, talented and motivated lead software engineer to join our founding team. You will be based in New York and report directly into the company’s co-founder and CTO.

Joining us this early means you’re going to have huge influence over the technical and cultural evolution of the company. You are signing up for a fast-paced working environment with a high bar for quality. We are working on hard problems and we have high expectations for one another.

This is a great fit if you hope to start your own company one day.

Together, we’re going to face the hardest technical challenges this journey has to offer head on.

What you’re signing up for:

API Design & Architecture

• Architect, build, and scale an API service leveraging the latest cloud infrastructure designed to run the leading ML architectures and frameworks
• Develop endpoints, for features such as RAG, continuous fine-tuning, user-feedback, and more to help app developers build LLM-powered apps faster
• Integrate additional proprietary LLM providers into our unified API
• Manage integrations with leading inference servers for LLMs and embeddings and training servers for continuous fine-tuning
• Develop and maintain integrations with data stores and sources

Front-End & Developer Experience

• Ownership to develop and maintain the front-end user experience for application developers
• Craft user documentation (We currently use Readme)
• Develop and maintain developer-friendly SDKs
• Develop user sign-up and sign in flows, API key management, and API usage dashboards
• Implement enterprise-grade authentication, authorization, and billing functionality

Community & Industry Engagement

• Represent the perspective of the application developer and advocate for their needs across the organization