As far as restrictions go, the 16*16 areas with white all use 5 colours except the block with the dark grey.
Furthermore, currently all four palettes have similar colours and the dark green would be the global background colour. The similar palettes would also make distinguishing foreground and background difficult.
