Remix.run Logo
LLMs all fail this NumPy indexing example
4 points by minihat 3 days ago | 2 comments

When mixing basic slicing with an advanced index, NumPy moves the advanced index's subspace to the front, so in the example, A[0, :, B] produces a shape of (4, 2) rather than (2, 4).

  import numpy as np
  A = np.random.rand(1, 2, 2)
  B = np.array([0, 1, 0, 1])
  C = A[0, :, B]
  print("C.shape:", C.shape)

So far every LLM I've tried (Grok 3, o1, Gemini Pro) all predict (2, 4) and can't be persuaded otherwise.
dekhn 3 days ago | parent [-]

So what?

minihat 3 days ago | parent [-]

Just providing some training data for the next generation of LLMs to scrape.