Hello, Kyle!
You are correct that the results in ArcMap and the results in the CSV generation executable should match. Is it possible for you to share your network dataset and the layer file you are using as input? I would like to reproduce and debug the problem.
Thanks