I say Higher. If nothing else, it tends to be "roll X or better" and in most contexts more=better. This is reinforced through most scoring systems, whether it's tests in school, or scoring in the Olympics, but we generally recognize recieving a higher number as having done better.