I believe the problem is that the jobs directory has to be on disk to store the scratch.gdb, pdf, and other outputs. The file server that will store the jobs directory won't be highly available as it's simply a file server. I'm not sure what the highly available storage options are in AWS, (other than S3 and DynamoDB, of course).