Linx Security Hits 76% Accuracy With Minimal Inventive AI Setup
Linx Security saw Inventive AI answer 167 of 186 questions at a 76% accuracy rate with no curation and minimal knowledge hub setup.
What they cover
Heather Mengarelli, a Solutions Engineer at Linx Security, reports that Inventive AI answered 167 of 186 questions at a 76% accuracy rate without curation. She notes these results came from the library hub as-is, with only minimal work putting the Knowledge Hub together.
Highlights
- 0:00Generated answers for a new RFP from an empty project
- 0:28167 of 186 questions were answered automatically
- 0:5076% accuracy against the actual submission, with minimal setup
Of the 186 questions, 167 of them were answered. The accuracy rate was 76% against the actual, so I thought it was pretty good.
Full transcript
1:49 video · Solutions Engineer, Linx Security0:00Heather Mengarelli
Overall, so good. So yesterday, or actually not yesterday, before we had another RFP come in and what I did is I uploaded an empty project and just saw like, hey, this is, I want just generate answers.
0:21Heather Mengarelli
And actually pretty interesting. Let me just quote my. So of the 186 questions, 167 of them were answered. I didn't like curate on my I just took if there was an answer I took it. And then I compared it I threw it in Claude and then I also compared it to the one that was generated by the team itself, the one that we actually submitted.
0:50Heather Mengarelli
And the accuracy rate, and this is just with our library hub as it is was 76% against the actual. So I thought it was pretty good. So I was going to share that with with my founder tomorrow to be like, listen, this is without even minimal work of putting the knowledge hub together. And we were able to get, you know, 76 of it was done and pretty accurate.
1:23Heather Mengarelli
The only other call out which is expected. Basically, I'm saying under claiming what we can and can't do. And that was like 37 of the 180 questions were marked as like almost like conservative on what we can and can't do.
1:40Heather Mengarelli
But again, without having eyes looking at the answers, I thought it was pretty good. So,
