Hamza Hassan

Applied AI Engineer

Senior AI Evaluation Engineer with 7 years of experience building LLM benchmarking pipelines and rubric-calibrated training artifacts. Built a production evaluation harness with 37 anonymized cases, independent judge panels, and CI regression gates to prevent regressions. Strong in Rubric Architecture, Golden Tasks creation, and failure analysis of hallucinations, with clear written reasoning and autonomous independent contractor delivery experience.

Projects

Jan 2026 — Present

Infra Foundry

Open Source Maintainer

  • A platform-agnostic cloud infrastructure components library for modern applications. Built with TypeScript and Pulumi, Infra Foundry provides reusable, composable infrastructure components that work across AWS, Cloudflare, and Vercel.
  • IaC
  • DevOps
  • Pulumi
  • AWS
  • GCP

Apr 2026 — Jul 2026

AI-Evaluation GTM Pipeline Engine

Lead Engineer & Architect

  • Built and engineered an end-to-end, 10-stage GTM engine for an AI-evaluation startup using TypeScript and GitHub Actions. Designed as an idempotent, Notion-backed state machine, the pipeline processes YC prospects via a provider-agnostic Claude client (Anthropic and AWS Bedrock via secure OIDC) with automatic model fallback and an automated, fail-closed IMAP reply-sweeper. To drive growth, I transformed pipeline artifacts into AI-generated evaluation rubrics that double as cold-outreach lead magnets, turning backend infrastructure into a high-leverage product-led growth loop.
  • TypeScript
  • Claude API
  • AWS Bedrock
  • GitHub Actions
  • Notion API
  • Resend
  • OIDC
  • n8n

Experience

Aug 2025 — Present

Founder

ResumizeAI

  • Founded and delivered an AI job-application platform using Next.js, TypeScript, NestJS, and PostgreSQL, managing product, engineering, deployment, and operations.
  • Engineered a three-stage LLM pipeline for job analysis, experience mapping, and resume generation, using structured schemas and runtime validation to ground outputs.
  • Built a production-pipeline evaluation harness with 37 anonymized cases, deterministic grounding checks, independent LLM judge panel, and CI regression gates with prompt hashes.
  • Designed job-centric workflows and data relationships that enforced grounding limits and per-question context, reducing ungrounded generations via structured prompt constraints.
  • Modeled per-stage LLM token costs and tier-specific model routing to balance generation quality, unit economics, and subscription-credit monetization decisions.

Nov 2024 — Jul 2026

Senior Software Engineer, AI Systems

Mercor

  • Authored golden responses and performed rubric calibration to create reference solutions and consistent scoring criteria for coding-agent training and benchmarking.
  • Built reinforcement learning environments and then led delivery as Project Manager for a 40-engineer effort producing 35+ Model Context Protocol apps.
  • Created RL environments and trained models on 174 open-source repositories across TypeScript, Go, and Python, contributing top-ranked engineering results for dataset curation.
  • Automated 90% of the end-to-end delivery workflow with Slack bots and GitHub CI automation, accelerating experiment turnaround and reproducible deployments.
  • Deployed multi-agent experiment systems integrated with n8n, enforcing reproducibility through versioned artifacts and automated runbooks for evaluation runs.

Apr 2022 — Oct 2024

Full Stack Engineer

Morningstar Ventures

  • Led migration from a Ruby on Rails monolith to NestJS microservices and Serverless components, improving deployment agility and fault isolation for product teams.
  • Designed an event-driven architecture using AWS EventBridge and SQS to synchronize services and maintain near real-time data consistency across bounded contexts.
  • Built end-to-end cloud architecture with GitHub Actions CI/CD, Docker, and Kubernetes on EKS to enable zero-downtime deployments and standardized release runs.
  • Implemented test automation suites with Jest and RSpec, reducing production bugs and improving release stability through systematic regression checks.
  • Reworked backend queries and PostgreSQL indexing to decrease response times under load, improving data throughput for downstream processing pipelines.

Aug 2021 — Mar 2022

Full Stack Engineer

Pairing

  • Built a scalable Node.js server with PostgreSQL and RabbitMQ for background job processing, increasing throughput and reliable task execution under high traffic.
  • Developed end-to-end features using Ruby on Rails and React, owning backend APIs, data integrity, and feature delivery across cross-functional teams.
  • Established CI/CD pipelines on GitLab and enforced code quality with Prettier, ESLint, and Husky to accelerate safe deployments and reproducible builds.
  • Implemented operational reliability and design trade-offs to support scalability and fault handling, documenting decision criteria and failure modes for engineers.
  • Collaborated on system design and reliability improvements to support stable production services and clearer developer onboarding documentation.

Jun 2019 — Jul 2021

Full Stack Developer

Pursue Today

  • Built a GraphQL e-commerce platform on Node.js with React and MSSQL, optimizing data retrieval patterns for a large product catalog.
  • Integrated Elasticsearch and Redis caching to reduce product query latency and improve search relevance for high-concurrency traffic.
  • Implemented third-party payment integrations including Stripe and PayPal with robust error-handling and transactional reliability controls.
  • Designed reusable frontend components and developer documentation to standardize integrations and speed feature rollout across teams.
  • Maintained data integrity and operational monitoring to ensure uptime and consistent behavior during peak load events.

Skills

  • Rubric Architecture
  • Golden Tasks
  • Failure analysis of LLM outputs (hallucinations, logical fallacies)
  • Articulate Reasoning
  • Independent contractor
  • AI evaluation experience
  • Prompt difficulty and complexity assessment
  • TypeScript
  • Node.js
  • Next.js
  • NestJS
  • PostgreSQL
  • Amazon Web Services
  • Pulumi
  • n8n
  • GitHub Actions
  • Docker
  • Kubernetes
  • Redis
  • RabbitMQ
  • OpenAI API

Education

Jul 2016 — Jul 2020

Lahore University of Management Sciences (LUMS)

Bachelor of Computer Science · Computer Science