You can't bring people in the same office from three different timezones. Most probably your setup was the problem, not the productivity of the people working remotely. Remote people working in the same timezone are usually very effective in their job.