I always assumed that in the early 1800s there were probably a few who had no legal education but according to Wikipedia

   Every person who has been nominated to the Court has been an attorney.

Of course your point stands, the only qualification for a justice is nomination by POTUS and confirmation by the senate.