For such big data, you should definitely be using an efficient format, not JSON.