The closest I can recall to a novel reference is a folk legend mentioned in I, Jedi, of how the first Force-user came to Camaas to learn the moral use of "his" power.
While this could be merely a Camaasi culture legend (think of what it says about Camaasi morality), it is the best we have at the moment.
It implies that the "first Force-user" was male, and appeared after interstellar travel had been around long enough for Camaas to be known.
"Party." --High Priest Harrar