Can you customize how strict an AI code reviewer is?

Short answer: Amar Goel says teams can add custom rules, choose an essential mode for production-level issues or more comprehensive feedback, and the agent learns from what the team actually does. Some teams use it to help junior developers learn.

Watch this answer from Episode 23

Watch this answer from Episode 23 (starts at 13:35) · Episode 23 notes and transcript

What was said on Built This Week

From Episode 23: OpenAI Code Red? The New AI Reviewer Changing Everything, starting at 13:35.

Jordan Metzner [13:34]: I guess, as these teams start to get these PRs rejected, they get even better at like their processes and so that also inherently speeds up the team. Right? The flywheel gets smaller and smaller for issues that get blocked into PRs. Right?

Amar Goel [13:50]: Yeah. I mean you can also implement custom rules and guidelines. The agent actually looks at what the product historical discussions your team has had. It also learns, like, what things your team is not paying attention to that we're flagging. So we're saying, hey. Your team doesn't care. But, yeah, I mean, I think it's a great we've seen a lot of people say, hey. This helps my junior developers learn. Right? Because the agent is flagging stuff. So some people want the agent to be noisier and chattier in the sense of, like, highlighting more issues because they're like, hey. These teams can learn from this. Other teams are like, hey. We just want, like, production level issues, that are gonna cause big problems in production, and we call it, like, essential mode. So, every we find every team's a little bit different in terms of what their needs are and what their, desire is, but it is a learning tool as well.

Amar Goel [14:39]: Absolutely.

Sam Nadler [14:40]: Can your customers set these settings? Can they have it, hypersensitive or, lower sensitive? Amazing.

Amar Goel [14:47]: Yeah. Yeah. So you can say, hey. I only want, like, really essential issues. I want more comprehensive thing. I want you to flag these other issues. And then the agent, like I said, is learning from what your team actually does. Lots of teams or let me say team leads or engineering leaders have a different vision of what they want than what the team actually does. And so that's also we're finding that it's helpful for us for the agent to learn like what is the team actually doing? And we've seen some teams say the engineering says, don't look at what my team does. Here's what we need. And so I want the agent to do this every single time. And then other people are like, you should learn from what my agent's doing my team's doing and then adjust.

Jordan Metzner [15:29]: That's cool. Yeah. Obviously, it depends on the product, what they're building, what their stack is, I mean, what the team's goals are. I could totally see I can even see just depending on, like, even the repo or even who the developer is. I mean, maybe for a lower level developer, you would maybe want, like, more restrictions on him and, it's a higher level expectations versus maybe higher level developers and maybe give them kind of more freedom over time. Super cool. Well, Amar, awesome project. Really, really cool application. And One more question. Yeah. Sure. Obviously, people can go to bito.ai. But, how else should they get in contact with you? I mean, go ahead, Sam. Sorry to

Sam Nadler [16:08]: Yeah. I was just you know, without giving anything away that's top secret, kinda what's next? What's on the horizon, that that you're excited about?

Amar Goel [16:17]: Yeah. I mean, we actually have an exciting product launch coming up next week, that, I won't totally share it all yet, but I think, I talked about deep code based understanding being kind of one of the things that we've really, really focused on. And I think we've been, both thinking how can we help customers get more value out of that, but also people asking us and kind of, saying, hey. How do we, how can we leverage this outside of just code review? So that's, an area that we're working on and, really excited about for now.

Jordan Metzner [16:50]: That's awesome. Okay. Cool. So we don't wanna ruin that. Awesome. And, cool, awesome product for developers. And let's jump into the news. Let's go ahead, Sam.

More questions from this episode

Go deeper

New episode every week

Watch us build with AI, live.

Real builds, founder interviews and the AI news that matters. Join 43K+ builders on YouTube.

▶ Subscribe on YouTubeBrowse all episodes →