| ▲ | faangguyindia 16 hours ago | |
I operate an analytics site (pretty big one B2B where client's backend feeds data into our system), and we see tons of traffic originating from northwestern China (Xinjiang) from Shenzhen Tencent Computer Systems Company Limited. There are also half a dozen other companies from China continuously hammering our clients’ websites. I was wondering, what's in that cold dessert? Low and behold satellite imaging shows massive datacenter build outs, very cheap solar energy. Few months ago something happened and the Geo location on data on those IP now shows "Shanghai" or "Shenzhen". A way to cover tracks? But mapping latency still points to fact that nodes behind these IPs are still operating around Xinjaing region credit: 'You Can't Cheat Time: Finding foes and yourself with latency trilateration' https://youtu.be/_iAffzWxexA HN user: lopoc Shenzhen vs Xinxiang is hard to do using this technique but Shanghai vs Xinxiang does show difference. Assuming that China only distills is a huge mistake. It’s no longer some backward place that does low value copying. Look at companies like ByteDance and Xiaomi. Chinese companies aren’t just distilling, they’re acquiring data in the same way American companies did by paying people and crawling the internet. The way I understand it, China has a few large companies that crawl the web at a rapid rate and build corpora. The government essentially wants select few companies to do this and then make the data available to other strategic companies operating within China. Then there are data aggregators that buy data from apps, websites, and services, as well as systems like OpenRouter or Cursor, where companies can learn from the “traces” of coding agents, chats, and so on. This massively reduces costs, as smaller companies like DeepSeek don’t have to do their own crawling or acquire data from 100s of websites and coding agents etc.... There are also companies in China that buy American LLM APIs and proxy them to companies within China. So, there could be 10,000+ companies using American AI products, while China logs all of this, understands how they’re being used, and trains on their traces. | ||
| ▲ | feisuzhu 6 hours ago | parent | next [-] | |
And, non-state run Chinese companies are just like companies in US, they usually don't joint forces to maintain a common infrastructure, if they can build moat (or at least be in leading position for a period of time), they do it, sharing crawl dataset is no go. | ||
| ▲ | feisuzhu 6 hours ago | parent | prev | next [-] | |
I thought you got the location from BGP registration, then IMHO the before/after are both correct, it might be datacenter in Xinjiang belongs to Tencent. | ||
| ▲ | prox 6 hours ago | parent | prev [-] | |
What does this line mean “ the web at a rapid rate and build corpora.” , what are they trying to do? Suck up data for training AI or something else? | ||