▲ | epolanski 6 days ago | |
> Mistral models are not very competitive with other proprietary models. As an enterprise user of various models, this is absolutely wrong and false. What matters when using models as a service is: - type of work involved - speed - cost - law compliance And, believe it or not your benchmarks IRL are worthless for most of the things you want to give to AI (unless we talking about coding idk). I'll provide you few examples where Mistral is by far the best option for our companies from applications in production, even ignoring the last one. - customer care assistance. One of my clients is in the business of home renovation, customers call the company to have details about how to install/mount specific things. For my use case: OCR + information retrieval from the scanned documents + reporting to our assistancs Mistral displayed by far the best performance (they have the best AI OCR we tested) and cost effectiveness and speed. - creating user-tailored daily financial news. We need to summarize, rank and report what happened for user-held securities during the day. The only competitive alternative here to Mistral was Google's Gemini Flash, we need to do this for tens of thousands of users. Mistral Small was absolutely up to the task, with the Medium variant for ranking and bundling. We have tested the other options and literally nobody offered the same performance/cost/speed | ||
▲ | fastball 6 days ago | parent [-] | |
FWIW in my own testing I found Gemini OCR better than Mistral. |