[Remote] AI Developer Jobs in Canada
Note: The job is a remote job and is open to candidates in USA. Rex.zone builds AI-powered recruiting and talent solutions, and they are seeking an AI Developer to focus on building, evaluating, and deploying AI systems used in real-world ML training pipelines. The role involves developing data pipelines, implementing evaluation harnesses, and contributing to content safety labeling workflows.
Responsibilities
- Build and maintain AI services for training and inference (batch + real-time APIs)
- Implement evaluation harnesses for LLM evaluation, prompt evaluation, and regression testing
- Integrate RLHF feedback loops and human review tooling to improve model behavior
- Develop data pipelines supporting data labeling, NER, and computer vision annotation at scale
- Define metrics for model performance improvement and monitor quality drift in production
- Partner with annotators/QA to enforce annotation guidelines compliance and resolve edge cases
- Contribute to content safety labeling workflows (policy routing, moderation, audits)
Skills
- Strong Python engineering with ML frameworks (PyTorch/TensorFlow) and API development
- Experience with LLM pipelines, evaluation datasets, and prompt iteration
- Familiarity with MLOps, CI/CD, containerization, and cloud deployment
- Knowledge of NLP (NER, classification, retrieval) and/or CV (detection, segmentation)
Company Overview