I Have A Semi

Am I giving people too little credit if whenever I use a semicolon I hesitate because I feel like whoever's reading is more likely to think I'm giving them an emoticon wink than using a grammatically legitimate punctuation mark?