To answer your question, yes. I would aim for a better fit, than what you currently have with that new barrel. I bet the POI would be quite different between those two barrels.Is it common that OEM P320 barrel may require fitting? See the pics:
Here is how a different barrel fits in the same slide:
Do I need to do fitting (filing) or this is a defective barrel and I need to exchange it?