Unexpected message received Failure(java.net.ConnectException: Address already in use)

Question

ArcGIS Workflow Manager: Version 10.9.1 High-Availability Enabled: Yes (2 Nodes) OS: Windows Server 2022 Noticed below messages in the Workflow Manager logs. Unexpected message received Failure(java.net.ConnectException: Address already in use: no further information: /:443) No buffer space available (maximum connections reached?): connect: /:443) When the above error occurs, Workflow Manager is becoming completely unresponsive (Workflow Manager Server web page showing infinite loading icon). It's coming back to normal only after restarting the machines. @JFarmer requesting for your valuable response please.

Ranga_Tolapi · Answer

Hi @JFarmer

For now, we added below registry entries with Decimal values and restarted both the WFM machines.

* MaxUserPort (65534)
* TcpTimedWaitDelay (30)

Not sure this can address the issue fully or not.

JFarmer · Answer

Hi @Ranga_Tolapi

I'm aware of this issue you've reported and this one: https://community.esri.com/t5/arcgis-workflow-manager-questions/fatal-sorry-too-many-clients-already/m-p/1313436#M1885.

We've been chatting with Tech Support on this but this looks like a core ArcGIS Enterprise issue from what I've seen so far. It seems like a Data Store user connection limit issue or some other Data Store issue to me. Has that been looked into? I think the Workflow Manager side of this is just the symptom of a problem with Data Store.

I'm not aware of any other users that have reported this issue so I don't have a specific answer here. It may be best to continue working with Tech Support (and we can as well as needed) to see where we can get there.

Jonathan