One of the main properties of REST: "Each request from any client contains all the information necessary to service the request, and the session state is held in the client."
In practice, REST makes things like caching, load-balancing, and debugging easier at the cost of needing to send more state back and forth. In HTTP, there are ways to reduce or at least hide the repeated TCP handshakes.