In testing the "Write to a CSV File" output connector, I've noticed that it really only has 2 options for the file created. It either creates a rolling csv file until a certain file size threshold is met or a timer based threshold to create a new file. I've also tested the archiving function and it too will lock a file and append records to an existing CSV until a threshold.
I would like to be able to setup an external process to monitor this folder for new files but the way in which it locks the file until the threshold is met, prevents me from really picking up a file when a new event is processed. Even if I read from the file, there could be additional records appended to the file after I read from it.
Is there a way to setup a file output connector that creates a single file per event record?
