Location: REMOTE / Montreal, Quebec
This job allows you to work remotely.
About the Role
Our client is an early-stage, venture-backed technology company building AI-powered software for engineering teams. Their platform combines generative AI, machine learning, simulation, and validation technologies to help customers identify complex issues earlier in the product development lifecycle.
They are hiring a Senior AI Developer to help build and improve the AI systems at the core of the platform. This role focuses on designing, evaluating, and continuously improving production AI workflows that operate on complex technical data, including structured and unstructured documents, graphs, tables, and domain-specific engineering information.
This is a highly hands-on role for someone who enjoys experimentation, debugging, and shipping practical AI systems that create measurable business value.
Key Responsibilities
- Build and maintain AI-powered workflows for extracting, organizing, and validating complex technical information
- Develop retrieval, agentic, and evaluation systems that improve the accuracy and reliability of AI outputs
- Design benchmarking pipelines and evaluation frameworks used to measure and improve model performance
- Build self-improving feedback loops that connect production usage, evaluation results, and model improvements
- Develop tools and integrations that allow AI agents to interact reliably with platform services and data
- Investigate model failure modes and identify opportunities for improvement across prompts, schemas, retrieval systems, and data pipelines
- Partner closely with domain experts to translate specialized knowledge into effective AI workflows
- Continuously improve experimentation processes, metrics, and evaluation methodologies
What They're Looking For
- Strong experimentation mindset
- Excellent attention to detail
- Curiosity and continuous learning
- High ownership and accountability
- Ability to operate independently in a fast-moving environment
- Strong communication and collaboration skills
- Passion for building practical AI systems that solve real-world problems
Special Perks:
Compensation & Benefits
- Competitive compensation package
- Equity opportunity
- Comprehensive health benefits
- Fully remote within Canada
- Opportunity to help shape the future of AI-powered engineering software at a high-growth venture-backed company
Must Have Skills:
Required Qualifications
- 3–5 years of hands-on experience in AI/ML, applied machine learning, or data engineering
- Practical experience with LLMs, including prompt engineering, RAG, agentic workflows, or similar techniques
- Experience building or supporting production AI systems
- Strong TypeScript experience
- Strong understanding of experimentation, evaluation frameworks, benchmarking, and measurement
- Excellent debugging and root-cause analysis skills
- Experience with Git and collaborative software development practices
- Strong written and verbal communication skills
- Degree in Computer Science, Engineering, or a related STEM discipline
Nice to Have Skills:
Preferred Qualifications
- Experience building tools and integrations for AI agents
- Experience with retrieval systems, vector databases, embeddings, and context management
- Familiarity with AI observability and evaluation platforms
- Experience building cloud-based data pipelines
- Exposure to technical, engineering, scientific, or industrial domains
- Startup experience
- Advanced STEM degree
