its backwards because hes got oars, not a paddle. oars propell a boat by using the pulling motion of the arms to move the ends from in front of the oarsman to behind, so hes pushing it backwards. in a small boat you can move in the same direction you are facing by using a pushing motion, but this is much more difficult especially on a longer boat, which is why the oars are typically faced towards the aft so as to make forward motion easier and therefor capable of being quicker
just thought id put my 2 cents in