RELU would have made it flat below zero ( _/ not \/). Adding the abs first just makes RELU do nothing.