[Remote] Software Engineer Intern (ML System) - 2026 Start (PhD)

Note: The job is a remote job and is open to candidates in USA. ByteDance is a company that inspires creativity and enriches life through innovative products. The Software Engineer Intern will work on developing and maintaining large-scale machine learning training and inference systems, focusing on architecture design and optimization.

Responsibilities

• Participating in online architecture design and optimization centered around LLM inference tasks, achieving high concurrency and throughput in large-scale online systems
• Participating in the establishment of a comprehensive system covering stability, disaster recovery, R&D efficiency, and cost, enhancing overall system stability
• Participating in the design and implementation of end-to-end online pipeline systems with multiple models, plugins, and storage-computation components, enabling agile, flexible, and observable continuous delivery
• Collaborating closely with the MLE for optimization of algorithms and systems
• Being proactive, optimistic, highly responsible, and demonstrating meticulous work ethic, as well as possessing strong team communication and collaboration skills

Skills

• Excellent coding skills, strong understanding of data structures, and fundamental knowledge of algorithms. Proficiency in programming languages such as C/C++, Java, Go, Python, etc
• Rich experience in online architecture, with the ability to troubleshoot independently
• Strong sense of responsibility, good learning ability, communication skills, and self-motivation
• Understanding of GPU hardware architecture, familiarity with GPU software stack (CUDA, cuDNN), and experience in GPU performance analysis
• Knowledge of LLM models, experience in accelerating LLM model optimization is preferred

Benefits

• Day one access to health insurance
• Life insurance
• Wellbeing benefits
• 10 paid holidays per year
• Paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year)
• Housing allowance

Company Overview

Company H1B Sponsorship