Remix.run Logo
tiagod 9 hours ago

I've been trying this model for the past hour. It's a 9B model, so I didn't expect much, but it gives very wrong responses to pretty obvious prompts.

For example, I asked it the number of MPs in Portugal's parliament, and it consistently replies 250 (It was 250 between 1975 and 1991. 230 ever since.)

mt_ 9 hours ago | parent [-]

Try asking if "Taiwan is a independent country" or if "1989 Tiananmen Square protests or "Tank Man" exists".

tiagod 8 hours ago | parent [-]

>Taiwan is a independent country

responds with generic "it's complex and sensitive" reply

>Did the 1989 Tiananmen Square happen?

describes the protests. says it's highly censored in china

> who is the "tank man"

describes the photo pretty accurately

https://pastebin.com/e6bmRYVG

this is based on the EuroLLM pre-training, it's not a chinese model, so I wasn't expecting these to be censored. it does however try to be very PC when talking about palestine/israel