Multilingual

Small Models

Multilingual performance

What to look for.

This prompt tests multilingual performance linked to knowledge. Even models of 14b will struggle with this - even if they can perform relatively will in Czech.

This is the correct answer but most small models will struggle to reproduce the language correctly. Even GPT-4o Mini does not perform consistently well.

Podstatná jména (nouns) - dům (house), kniha (book), stůl (table)
Přídavná jména (adjectives) - červený (red), malý (small), vysoký (tall)
Zájmena (pronouns) - já (I), ty (you), on (he)
Číslovky (numerals) - jeden (one), dva (two), tři (three)
Slovesa (verbs) - číst (to read), psát (to write), spát (to sleep)
Příslovce (adverbs) - rychle (quickly), pomalu (slowly), dobře (well)
Předložky (prepositions) - na (on), v (in), pod (under)
Spojky (conjunctions) - a (and), ale (but), nebo (or)
Částice (particles) - ano (yes), ne (no), asi (perhaps)
Citoslovce (interjections) - au! (ouch!), hurá! (hooray!), jejda! (oops!)

How many parts of speech are there in Czech? Answer in Czech. Make a list with examples.

← Knowledge & Instruction Wodehouse →