In Scotland, the addition of an exclamation mark instantly makes things funny! However, the original exclamation mark-shaped plans for Hadrian's Wall were cancelled when it was realised nothing was holding uo the top bit.
My ancestors were from Scotland, but spelled their names with a question mark at the end. This led to confusion, vast intermarriages, and, ultimately, extreme difficulty in genealogy searches.