You can raise the ram limit by disabling the modem as it turns out! It uses the same ram as the rest of the SOC so turning it off gets you that back.