Senior Software Engineer, Go - LLM Team at AssemblyAI. Location Information: United States. AssemblyAI is an applied artificial intelligence company. We use the latest deep learning technology to build practical products that bring futuristic ideas to life.. Our team includes researchers, engineers, and designers that have worked at some of the largest technology companies all over the world. Our main office is located in downtown San Francisco.. At AssemblyAI, we believe that cutting edge artificial intelligence technology should not be limited to only those with the funding or resources to invest in it.. Our goal is to help make creative, new ideas possible by making AI technology accessible to everyone through easy to use products, whether you are an independent developer, startup, or global company.. Partner closely with the customer success team to understand customer use cases, challenges, and integration needs. Translate customer pain points surfaced by the CS team into technical solutions and product improvements. Build features and tooling that directly address customer needs and improve their workflows. Provide technical guidance and expertise to the customer success team. Own and deliver complete features and integrations within our LLM gateway service. Build and maintain integrations with multiple LLM providers and AI services. Write clean, maintainable, well-tested code following best practices. Design and implement scalable, fault-tolerant solutions. Proactively identify and address technical debt, reliability issues, and code quality concerns. Participate in on-call rotation to ensure service reliability and rapid incident response. Conduct thorough code reviews. Ensure proper test coverage across unit, integration, and end-to-end testing. Improve code maintainability and extensibility through targeted refactoring. Contribute to runbooks, incident postmortems, customer-facing documentation, and knowledge sharing. Identify bottlenecks and propose solutions to improve team velocity and system reliability. Work closely with product, customer success, and engineering teams. Collaborate with external API providers to troubleshoot integration issues. Translate ambiguous customer requirements into well-scoped technical work. Proactively communicate status, risks, and blockers. Mentor junior engineers. Participate in architectural discussions and contribute to technical decisions. 5+ years of professional software engineering experience. Strong proficiency in Go with demonstrated ability to write production-quality code. Hands-on experience with LLM APIs and understanding of prompt engineering concepts. Experience building or working with API gateways, proxies, and rate limiting systems. Deep experience with prompt engineering, chain-of-thought, few-shot learning, and other LLM optimization techniques. Experience building applications with llms or ai agents with cascading architectures. Solid understanding of software engineering fundamentals: data structures and algorithms, system design and architectural patterns, testing strategies. Experience with RESTful APIs and distributed systems concepts. Experience building or integrating with third-party APIs. SQL and database design. Version control (Git) and CI/CD pipelines. Containerization (Docker) and cloud infrastructure. Strong communication skills and ability to collaborate effectively with cross-functional teams. Pay range:. $180K - $240K. Competitive equity grants. 100% employer-paid benefits. Flexibility of being fully remote
Senior Software Engineer, Go - LLM Team at AssemblyAI