Unable to publish video services when ArcGIS Data Store Object store is Default Item Storage

[Ltod]

Hi all,

I'm trying to publish video services from Excalibur to ArcGIS Video Server.

When the default Item Store is configured on the File System, the hosted video layer publishes successfully.

However, when I set the default Item Store to the ArcGIS Data Store, publishing the hosted video layer results in a generic error in Excalibur. The Video Server logs display the following message:

"Impossible to connect to the object store. Error : Unable to execute HTTP request: Connect to xyzx failed: Connection refused: getsockopt"

I’ve checked the ports and opened those mentioned here:
https://community.esri.com/t5/arcgis-video-server-questions/error-creating-layer/m-p/1596227#M19

But I still can’t publish the video layer.

I'm working on ArcGIS Enterprise 11.5 and Windows Server 2019 environnement.

Could someone please help?

Thanks

[Josh_Piercy]

Hi Ltod,

Just a couple of questions:

• Have you recently upgraded from a prior version of ArcGIS Video Server or Enterprise? If so, what version(s) were upgraded from/to?
• If the above, have you also completed the step listed here: https://enterprise.arcgis.com/en/documentation/install/video/latest/windows/upgrade-video-server.htm....
• Does this machine shut off at any point? For example, have there been any power outages, shutting VMs off over the weekend, or anything of the sort?

If there is anything else you can let us know about the environment/behaviors, when this started, etc it would help us to determine a cause & workaround. Thank you!

[Ltod]

Hi @Josh_Piercy  thank you for the reply. 

• It’s a new deployment of ArcGIS Enterprise 11.5 with Video Server, not an upgrade.
• Everything is working fine on the VM, with no power outages or related issues.

We tried the same workflow on two other machines (ArcGIS Enterprise 11.3 and 11.4), but unfortunately the result was the same. This is the video we tried to upload https://learn.arcgis.com/fr/projects/get-started-with-arcgis-video-server/.

For the Object Store and default storage configuration, we followed the steps mentioned here : https://enterprise.arcgis.com/en/documentation/install/video/latest/windows/admin-operations.htm  

Thanks

[Josh_Piercy]

Thank you, and no worries! I apologize if some of these questions may sound redundant, we just need to build a full picture of how things stand currently:

• Have you specifically opened all of the ports required by ArcGIS Data Store? There are quite a few, and these getsockopt errors are specifically associated with communication failures across the Enterprise software suite. We would specifically suggest ensuring the Object Store ports are open on all involved machines: https://enterprise.arcgis.com/en/data-store/latest/install/windows/ports-used-by-arcgis-data-store.h...
• The fact that this error consistently occurs after setting the default Item Store to the Object Store suggests that there is something preventing communication from taking place between the Video Server and the Object Store in these environments that otherwise is not present when using the file system as the default.
• A reboot of ArcGIS Data Store Windows Service is also worth conducting if it has not been done yet- the typical restart order we suggest is:
  • Stop Portal for ArcGIS
  • Stop ArcGIS Server
  • Stop ArcGIS Data Store
  • Stop ArcGIS Video Server
  • Wait two minutes.
  • Start Portal for ArcGIS.
  • Wait two minutes. 
  • Start the other three in the order listed above, with one minute intervals.
• We seen the above clear up getsockopt issues in a some instances, but we would recommend making any port changes prior to this in order to ensure the software picks those changes up.

If this does not help let us know, we will continue troubleshooting to see where the cause of the error lies.

Thank you,

Joshua

[Ltod]

Hi Joshua, thanks for the workflow, 

1. Yes, I opened all the ports required by the Data Store as well as 25672, 44369, 45671, and 45672 (TCP).
   
2. I agree with your approach, but I’m struggling to pinpoint exactly what’s missing. Unfortunately, the logs are not very explicit this time—just the message: "Connection refused: getsockopt"
   
   
3. I restarted the components in the order you mentioned and waited 5 minutes between each step.
   However, the publishing has been running for hours now, which I can’t explain, especially since the file is only 79 MB.

If possible, could you please try publishing the video on your side to see if it works? Or could this be a bug or product issue?

Thanks again for your help.