Man in Room Manipulating Chinese Symbols
A man who knows no Chinese sits in a room and matches incoming Chinese characters against a rulebook written in English, then passes back the output characters the rules specify. To people outside, his answers are indistinguishable from a native speaker's. Yet he understands nothing, which shows that producing the right outputs by following formal rules is not the same as understanding.