Software Engineer (Backend Engineer)

Job Description: Software Engineer (Golang & LLM Focus) Company Overview A pioneering startup, recently empowered by a $3M seed funding round from top-tier investors, is building the next generation of intelligent data infrastructure. We are on a mission to bridge the gap between complex, unstructured data and actionable business intelligence. Our platform leverages cutting-edge artificial intelligence to unlock insights that were previously inaccessible, empowering enterprises to make smarter, data-driven decisions faster than ever before. We are a small, product-obsessed team of engineers and researchers who are passionate about solving hard problems. This is a ground-floor opportunity to shape the core architecture and product direction of a company poised to redefine its category. The Role: Software Engineer (Golang & LLM Focus) We are seeking a versatile and driven Software Engineer with deep expertise in Golang and a strong interest in Large Language Models (LLMs). You will be a foundational member of the engineering team, directly responsible for designing, building, and scaling the core backend systems that power our AI-driven platform. Your work will sit at the critical intersection of high-performance data processing, API design, and the integration of state-of-the-art LLMs into a robust, production-grade environment. This role is for someone who thrives in ambiguity, enjoys taking ownership of complex features from concept to deployment, and is excited to write code that will form the bedrock of our company.

Key Responsibilities

Design, develop, and maintain high-performance, distributed backend services in Golang. Architect and implement robust APIs and data pipelines for processing and serving data to and from our LLM-based inference systems. Integrate with various LLM providers (e.g., OpenAI, Anthropic) and open-source models, optimizing for latency, cost, and reliability. Contribute to the entire software development lifecycle, including concept, design, build, deployment, and operational excellence. Collaborate closely with ML researchers and engineers to productionize machine learning models and algorithms. Write clean, well-tested, and maintainable code, and participate in rigorous code reviews. Proactively identify and address performance bottlenecks, scalability challenges, and system vulnerabilities. Qualifications & Experience Must-Haves: 3+ years of professional software development experience with a strong focus on backend systems. Proven, hands-on experience building and shipping production-level services in Golang. Solid understanding of computer science fundamentals: data structures, algorithms, and system design. Experience with cloud platforms (AWS, GCP, or Azure) and containerization technologies (Docker, Kubernetes). A genuine passion for and understanding of the modern AI/ML landscape, specifically Large Language Models. Excellent problem-solving skills and the ability to work independently in a fast-paced, early-stage startup environment. Nice-to-Haves: Hands-on experience fine-tuning, deploying, or managing open-source LLMs (e.g., Llama, Mistral). Experience with vector databases (e.g., Pinecone, Weaviate, pgvector) and RAG (Retrieval-Augmented Generation) architectures. Knowledge of MLOps practices and tools for model deployment and monitoring. Familiarity with data engineering and processing large-scale, unstructured datasets. Previous experience in an early-stage, venture-backed startup.

What We Offer

Foundational Impact: Your code and architectural decisions will have an outsized impact on the product and the company's trajectory. Equity Ownership: A significant equity grant, ensuring you share directly in the value you create. Competitive Compensation: A competitive salary and benefits package, reflective of our recent funding. Cutting-Edge Tech Stack: The opportunity to work exclusively with modern technologies on challenging, green-field projects. A-Player Team: Collaborate with a small, dedicated, and highly skilled team that values learning and excellence. To Apply Please submit your resume and a brief note explaining your interest in this specific role, highlighting a relevant project involving Golang and/or LLMs. We are moving quickly and are excited to meet our next foundational team member. Underdog.io is a modern hiring marketplace that that caters to remote startup jobs for software engineers with pre-seed, seed, and series A-C high growth tech firms across the US. At Underdog.io, you create your ideal role and companies apply to you. Apply tot his job Apply To this Job