It depends what you use it for. Abrasives can use pretty much any horrible misshapen brown rock of roughly the right size.

But there are also applications for larger flawless crystals in things like diamond windows, semiconductor substrate and microtomes. Recently you can even buy a diamond 3D printer nozzle for extruding abrasive materials like carbon fibre. These require better processes than the ones that churn out abrasive diamonds.