It makes a lot of sense, and but then you have two code paths for tables.

The Lua folks want a simple codebase, so they (knowingly) leave a lot of performance on the table in favor of simplicity.

For what it's worth, there are already two code paths for tables. The array part is stored separately from the hash table part.