watching a folder with csv files.

[EliasLazarou]

Hello there,

I am working on ArcGIS 10.2.1 with ArcGIS Server GeoEvent Processor. Actually i am trying to work with a csv file that is stored in a folder which i have already registered in the GeoEvent Processor. The scenario is the simplest i can do.

I create an input "Watch a folder for new .csv files" connector.

I create an output "Publish text to a tcp socket" connector.

I create a GeoEvent Service connecting the above.

Now i am supposed to open the command line and see the progress of the data feed in the port 5570 (the port set up for the output connector.), but i see nothing instead.

The csv file is not Read-Only.

Does anyone have a clue on that?

Thank you in advance,

Elias

[Than_HtetAung]

Hi Guys,

I got the same issue, I still haven't got the input count even I change file name, add inside again.

I found an error in the log through.

Below is the error message, have any idea what are those?

esri.ges.fabric.internal.ZKPersistenceUtility

KeeperErrorCode = ConnectionLoss for /geoevent/config/clusters/default/arcgisServerConnections/b9fb6823-da12-4381-8e2b-855aa1aad9ea.json/ServicesCache.json org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /geoevent/config/clusters/default/arcgisServerConnections/b9fb6823-da12-4381-8e2b-855aa1aad9ea.json/ServicesCache.json at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)[23:org.apache.zookeeper.zookeeper-geoevent:3.5.0] at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)[23:org.apache.zookeeper.zookeeper-geoevent:3.5.0] at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1908)[23:org.apache.zookeeper.zookeeper-geoevent:3.5.0] at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:272)[386:curator-framework:3.1.0] at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:268)[386:curator-framework:3.1.0] at org.apache.curator.connection.StandardConnectionHandlingPolicy.callWithRetry(StandardConnectionHandlingPolicy.java:67)[387:curator-client:3.1.0] at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:99)[387:curator-client:3.1.0] at org.apache.curator.framework.imps.SetDataBuilderImpl.pathInForeground(SetDataBuilderImpl.java:265)[386:curator-framework:3.1.0] at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:251)[386:curator-framework:3.1.0] at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:39)[386:curator-framework:3.1.0] at com.esri.ges.fabric.internal.ZKPersistenceUtility.writeToPath(ZKPersistenceUtility.java:286)[77:com.esri.ges.persistence.zookeeper.zk-persistenceutility:10.5.1] at Proxy3e3e16b3_7f0d_43ae_b629_760aa838293a.writeToPath(Unknown Source)[:] at Proxy7d6ab7f4_95f5_4a75_83ee_1f279b55660e.writeToPath(Unknown Source)[:] at com.esri.ges.persistence.zookeeper.agsconnection.ZKArcGISServerConnectionDAO.persistServicesInfo(ZKArcGISServerConnectionDAO.java:251)[87:com.esri.ges.persistence.zookeeper.agsconnection:10.5.1] at Proxy1b4537cc_78b0_4c5e_967f_95879f61bf6d.persistServicesInfo(Unknown Source)[:] at Proxy93a7a385_e4f7_4f07_a60c_10dce2c13549.persistServicesInfo(Unknown Source)[:] at com.esri.ges.manager.datastore.agsconnection.internal.ArcGISServerConnectionManagerImpl.onArcGISServerConnectionStatusChange(ArcGISServerConnectionManagerImpl.java:790)[217:com.esri.ges.manager.internal-agsconnectionmanager:10.5.1] at com.esri.ges.datastore.agsconnection.DefaultArcGISServerConnection$CacheUpdater.update(DefaultArcGISServerConnection.java:163)[109:com.esri.ges.framework.datastore.agsconnection-datastore:10.5.1] at com.esri.ges.datastore.agsconnection.DefaultArcGISServerConnection$CacheUpdater.run(DefaultArcGISServerConnection.java:199)[109:com.esri.ges.framework.datastore.agsconnection-datastore:10.5.1]

10 Sep 2018, 4:39:55 PM

ERROR

com.esri.ges.fabric.internal.ZKPersistenceUtility

KeeperErrorCode = ConnectionLoss for /geoevent/config/clusters/default/arcgisServerConnections/b9fb6823-da12-4381-8e2b-855aa1aad9ea.json/ServicesCache.json org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /geoevent/config/clusters/default/arcgisServerConnections/b9fb6823-da12-4381-8e2b-855aa1aad9ea.json/ServicesCache.json at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)[23:org.apache.zookeeper.zookeeper-geoevent:3.5.0] at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)[23:org.apache.zookeeper.zookeeper-geoevent:3.5.0] at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1908)[23:org.apache.zookeeper.zookeeper-geoevent:3.5.0] at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:272)[386:curator-framework:3.1.0] at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:268)[386:curator-framework:3.1.0] at org.apache.curator.connection.StandardConnectionHandlingPolicy.callWithRetry(StandardConnectionHandlingPolicy.java:67)[387:curator-client:3.1.0] at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:99)[387:curator-client:3.1.0] at org.apache.curator.framework.imps.SetDataBuilderImpl.pathInForeground(SetDataBuilderImpl.java:265)[386:curator-framework:3.1.0] at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:251)[386:curator-framework:3.1.0] at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:39)[386:curator-framework:3.1.0] at com.esri.ges.fabric.internal.ZKPersistenceUtility.writeToPath(ZKPersistenceUtility.java:286)[77:com.esri.ges.persistence.zookeeper.zk-persistenceutility:10.5.1] at Proxy3e3e16b3_7f0d_43ae_b629_760aa838293a.writeToPath(Unknown Source)[:] at Proxy7d6ab7f4_95f5_4a75_83ee_1f279b55660e.writeToPath(Unknown Source)[:] at com.esri.ges.persistence.zookeeper.agsconnection.ZKArcGISServerConnectionDAO.persistServicesInfo(ZKArcGISServerConnectionDAO.java:251)[87:com.esri.ges.persistence.zookeeper.agsconnection:10.5.1] at Proxy1b4537cc_78b0_4c5e_967f_95879f61bf6d.persistServicesInfo(Unknown Source)[:] at Proxy93a7a385_e4f7_4f07_a60c_10dce2c13549.persistServicesInfo(Unknown Source)[:] at com.esri.ges.manager.datastore.agsconnection.internal.ArcGISServerConnectionManagerImpl.onArcGISServerConnectionStatusChange(ArcGISServerConnectionManagerImpl.java:790)[217:com.esri.ges.manager.internal-agsconnectionmanager:10.5.1] at com.esri.ges.datastore.agsconnection.DefaultArcGISServerConnection$CacheUpdater.update(DefaultArcGISServerConnection.java:163)[109:com.esri.ges.framework.datastore.agsconnection-datastore:10.5.1] at com.esri.ges.datastore.agsconnection.DefaultArcGISServerConnection$CacheUpdater.run(DefaultArcGISServerConnection.java:199)[109:com.esri.ges.framework.datastore.agsconnection-datastore:10.5.1]

10 Sep 2018, 4:33:25 PM

ERROR

Best Regards,

Than

[wizgis]

@Han-WenLIU @BrianBaldwin 

I am also having a similar issue. Were you able to find a solution to it. 

[BrianBaldwin]

@wizgis - This was years ago - but I vaguely remember inserting a 'date-time' at the end of my CSV file name when I was generating the files. That way - GeoEvent saw the CSV as a new file - even if after parsing, some of the records had not changed or updated, but it worked to ensure GeoEvent saw it as a new file each time.