I think there is a fundamental problem trying to express two emotions on a face by dividing it into left and right halves. Our minds look at the entire picture, and if each side of someones face is doing something different, then it looks strange and creepy. There's also lots of construction problems. Draw it in a few grey shades, then flip it back and forth to be able to spot the problems.