Your definition of orthogonal is incorrect, in this case.
In the case of binary vectors, don't forget you are working with the finite field of two elements {0, 1}, and use XOR.