I think the colors are fine...I love how much you simplify and symbolize...you're on to something very neat.
Right now, the lighting, or lack thereof, is killing the piece.
Here's a lame attempt to show what I mean:
Really all I did what change how it was lit.
With more dynamic and less symmetrical lighting, you can bring out the shapes and intricacies of the face.