When I can't tell if something was a back-handed compliment

whatshouldwecallme:

Should I smile? Should I not smile? Did they mean it? Did I hear that correctly?