| ▲ | bitexploder 2 hours ago | |
Which versions of flash and at what thinking levels? Which chinese flash models and at what thinking levels? What tasks? What completion rates? How was quality evaluated? | ||
| ▲ | pimeys 2 hours ago | parent [-] | |
- Which versions: 3.6 vs 3.7 vs. 3.8 for Gemini Flash, and v4 0731 for Deepseek v4 Flash, and GLM 5.3 Flash - Medium for Gemini, high for Deepseek. - Things like find information, then understand something about it, then send a slack message or email etc. - Completion rates somewhere in 80-90%, Deepseek a bit better than Gemini - Quality evaluated by Fable 5.1 and Astra 6.0 acting as a rubric judge. Gemini quality would probably be better with high thinking level, but that would be 40% more expensive. And Deepseek is already third the price of Gemini. | ||