> We have in the works a classifier for if a prospective customer will be long term profitable or not

I'm curious, why do you use a classifier for long-term profitability? Wouldn't predicting expected lifetime profit with a forecasting model be more meaningful than just predicting whether a customer will be profitable or not?

The purpose is to sort which customer to prioritise calling back versus putting at the bottom of the pile.

Eventually we hope to identify ones who are going to be lifetime duds.