Head of Assessment and Certification Content
About the Role
Our client, a global EdTech scale-up, is looking for a technical Head of Assessment and Certification Content to rebuild, modernize, and scale their credentialing engine. This is an individual contributor role designed for a system builder who can "clean house" - aligning our certifications with real employer hiring standards while deploying agentic AI systems to automate exam item generation, scoring, and validation.
Day-to-Day Responsibilities
Must-Have Qualifications
- Location: Remote (Belgium, Portugal, UK, US are preferred, but all Europe, UAE and the US are okay)
- Logistics: full-time employment (Belgium, Portugal, UK, US, UAE) or B2B contract in other locations
- Role Type: Individual Contributor (Project Management of external contractors who are reviewing content)
About the Role
Our client, a global EdTech scale-up, is looking for a technical Head of Assessment and Certification Content to rebuild, modernize, and scale their credentialing engine. This is an individual contributor role designed for a system builder who can "clean house" - aligning our certifications with real employer hiring standards while deploying agentic AI systems to automate exam item generation, scoring, and validation.
Day-to-Day Responsibilities
- Certification Strategy: Benchmark against industry credentials (e.g., Azure, AWS, Google) to map their certifications directly to real-world job skills.
- Assessment Engineering: Design psychometrically sound blueprints, write multiple-choice questions and practical case studies, and set rigorous passing standards.
- AI Automation: Build and operate agentic AI pipelines that draft, grade, and quality-check assessment items automatically.
- Contractor Management: Direct and manage external contractor reviewers who handle quality control checks on generated assessment items.
Must-Have Qualifications
- Technical STEM Background: Degree or equivalent industry experience in Computer Science, Data Science, AI, Statistics, or Engineering to judge technical item accuracy independently.
- Certification Program Experience: Proven experience designing, building, or managing technical certification programs, institutional assessments, or standardized testing workflows. (Having taken a certification as a user is not sufficient).
- Agentic AI & Engineering Depth: Hands-on experience building AI pipelines (using Claude Code, Cursor, etc.) to automate content generation.
- Deterministic Verification: Systems-thinking approach to software quality, capable of programmatically validating structured LLM outputs via code.
- Startup / Scale-Up Experience: Resilience, high stamina, and complete ownership needed to audit, rebuild, and optimize an existing product area independently.
- Certification Holders Only: Candidates whose experience is limited to passing exams rather than architecting assessment frameworks.
- People Managers: Candidates seeking a traditional organizational hierarchy; this role manages project workflows and contractors, not direct reports.
- Vague AI Skillsets: Applicants unable to demonstrate concrete code artifacts used to automate quality checks.