| ▲ | dannyw 2 hours ago | |
The XML tags are similar to <antml:xxx>, which is obviously Anthropic ML (or ANTrophic xML). I think it’s likely 3; meta in reverse. While tokenisers and preprocessing can catch it, you want your special tokens to be unique and not present in the original corpus. <meta: is likely too common. | ||