How does the ScreenEval AI tool score a recruiter screen?

Short answer: Sam Nadler says you paste a transcript and optional job description, the recruiter records their own call first, then the AI gives candidate scores, screen feedback such as weak follow-up probing, and suggested questions.

Watch this answer from Episode 29

Watch this answer from Episode 29 (starts at 3:51) · Episode 29 notes and transcript

What was said on Built This Week

From Episode 29: We Built an AI Recruiter Coach in 6 Hours (Plus Claude Cowork in Real Time), starting at 3:51.

Sam Nadler [3:51]: Hoping you can see it. It's got a great name called ScreenEval. This is the home page, new evaluation. So you literally take a transcript. I've got one right here for a back end engineer. Drop it in here. You can paste the job description, which will analyze the transcript against the job description, but it's not even necessary. Once you paste it in, it fills out these fields for you, who the candidate name, the role, the recruiter, the interview date, and then the theoretically, the recruiter will then provide their assessment. So I want them to provide their assessment before getting the take of the AI, and in fact, I never want them to change their assessment. We're really using it you know, there are little things that the recruiter can pick up on, potential red flags that may not be, captured by the AI. However, it will hopefully give them, like, at least a little bit reinforcement if they made a bad decision, or the summary will give them more context on how they feel. So either way, it takes two seconds. You submit to see AI evaluation and bada bing. So this candidate, your call was to move forward. AI also says

Sam Nadler [5:00]: To move forward. It gave a little bit of information about the candidate, their scores, communication experience, enthusiasm. And what I think is really helpful, it also gives me a screen performance. So solid screen overall. Rapport building was pretty good. Probably lacked a little bit in follow-up depth probing questions. We did discuss compensation. We did discuss timeline and next steps. Pacing was good. It gives me a potential other questions to ask. Walk me through your last technical decision. Yada. So long story short, it hopefully, you run this through, you feel confident about what your AI evaluation says. Even if it's not the same thing, we want the recruiters to move forward with their decision. However, it gives me a little coaching on maybe some of these areas I should focus on a little bit in my next screen. And then that what's really interesting is now that we have all the data of these screens, we can now search these transcripts.

More questions from this episode

Go deeper

New episode every week

Watch us build with AI, live.

Real builds, founder interviews and the AI news that matters. Join 43K+ builders on YouTube.

▶ Subscribe on YouTubeBrowse all episodes →