Short answer: Jordan Metzner says he gave Claude Google's 57-page 10-K and asked for a CFO dashboard, getting an executive summary plus charts on revenue, net income and free cash flow. Sam Nadler says OpenAI's output on the same document was weaker.
Watch this answer from Episode 11 (starts at 9:47) · Episode 11 notes and transcript
From Episode 11: Coding the Beat: Strudel, Claude Dashboards & OpenAI’s $1B Play, starting at 9:47.
Sam Nadler [9:47]: Perfect. And that leads us to our kinda next segment. We're gonna talk about a use case for Claude. I'm assuming most people are familiar with Claude and have used it for many different tasks. However, this specific use case, we use a lot, and I think it's great to show our network and our listeners about, this amazing feature from Claude. And, we've also we kind of run this test with other LLMs, and it's not nearly as good. So why don't you walk us through what we're doing and, a, this example, and then how we use it?
Jordan Metzner [10:24]: Yeah. So I think, we don't really need to do this, but in our prep for today's today's call, we ran this through some other LLMs and we found, that continually, Claude continues to outperform. And what I mean by outperform is you can give Claude a CSV, a spreadsheet, or a document, a PDF document, and it'll build you a pretty beautiful dashboard that is pretty cohesive. And so in this example, I gave it Google's latest financial filings. I think it was a 10 k. I asked something super simple. Make me a dashboard as if I'm a CFO after reading this document. And yeah. So I just had Claude put that all together. It gave me an executive summary here that we can read in the text, but it also gives me this beautiful dashboard of, Google's revenue for the quarter, including its, 96,000,000,000 in revenue and 28,000,000,000 in net income. And it even shows kind of a breakdown of where that revenue is coming from, operating expenses by segment, free cash flow, employees, all the way down to the bottom of the balance sheet. So, if I had additional questions or want to ask certain things, I could certainly do that. It looks like they have a settlement liability charge here for some privacy concerns and some other key considerations of risk. But, the document that I used to generate this was a 57 page document in PDF format with, financials and all different types of documentation. So, it's a great tool for investors, but it's a great tool for kind of almost any small business.
Jordan Metzner [11:52]: You can export, your financials from, Google spreadsheet, QuickBooks, Excel, kind of anywhere you want, and just have it make a dashboard for you. And, one of the things I like about this is that, it's almost like a throwaway tool. I'll use it once, I'll check out the dashboard, I'll look at it, and, next time I wanna make a dashboard, I'll just make a new dashboard. I don't need to save this, I don't need to it for anything. So it's almost like a one time use site. I find that really valuable and really helpful and, incredibly fast.
Sam Nadler [12:18]: Exactly. I think in this use case, we're using Google. But in our day to day use case, we're using, QuickBooks or other data that we have from our own businesses. And instead of maintaining a dashboard, we can quickly throw it up in Claude, and it's so incredibly digestible and beautiful. It's, it's it's hard to argue that there could be something better in the amount of time this takes. And we did, just for context, put it in, the same document in OpenAI. It wasn't nearly as good. It didn't provide the immediate visual. The summary was pretty good, but I would argue that it was too much to read. And then we had to prompt it a couple more times just to get the visuals, and the visuals, were there, but not nearly as I think it made four graphs.
Jordan Metzner [13:05]: You know? I made four graphs. And, here, we don't have any graphs, but we have really good charts that actually help you really understand what's happening in the financials. And, I mean, I didn't read the document, but I know pretty well how Google's doing just by, looking at this dashboard. So it definitely hits the spot as far as being effective and efficient.
Sam Nadler [13:24]: And you can do this with really any data, whether it's financial data. I was playing with some operational metrics today and all very, very useful in Claude. And it's, it's kinda funny how these LLMs excel or accelerate, and then who's better at what continues. Seems like it's constantly changing, which actually leads me to kind of our next topic, which is Codex. We've talked about a lot about using LLMs to write code.
