Many writers have struggled with this before learning the best way to deal with punctuation quotation. There are rules based on American and British English. However, he is a general rule you want to consider:
Commas, periods, question marks, and exclamation marks go inside the quotes
Parenthesis, colon and semi-colons go outside the quotes.