POST
|
Hi, I have been working on a tool to pull an MS Access query and transform it into a Portal Feature Service. Had it working for a week, but now it does not work anymore. There is one specific problem... There are 20 fields that contain a simple 1 or 0 in the Access db. When I export to CSV, all of the data in those fields is either a 1 or a 0 for every record. My Portal Feature Service is ready for those values in each of those integer fields with a domain (1=True, 0=False) . When I first made my Workbench Tool, it worked. I had an Access Reader, VertexCreator, CoordinateSystemSetter, Reprojector, and the Portal Feature Service Writer. Now, for some reason, all of my 1 values are writing as -1 (negative one). I have no idea why. When I look at a table, I see "No" or "-1" now. The 0 (zero) is coming out right, but the 1 is being changed to a -1. I have been tearing this tool apart, building new ones, to no avail. I have found that the field type of all of these 1/0 fields coming out of the MS Access Reader are defined as "[yesno]". When inspecting the data of the reader and each of the Transformers, I see values of "Yes" and "No" for each. Seeing that the 0 is obviously making it into my Feature Service correctly, I thought that I could just open up the writer and in the Value entry for every one of these fields - and use the Arithmetic Editor and say [fieldname]*-1. Hey, 0*-1=0 (no change) and -1*-1=1 (yay, positive one). BUT alas, it said that I had a string calculation error - can't math "No"*-1. So - how is the No being converted to a 0 and the Yes being converted to a -1. (I am seriously confused now...) So I found the AttributeValueMapper and, in one field, mapped "Yes" to 1 and "No" to 0. Ran the tool, and it worked. Well - now I have to format an AttributeValueMapper for another 19 fields???? This does not seem right. What am I missing? Thanks, --Adam
... View more
|
0
|
0
|
12
|
POST
|
I am making a Spatial ETL tool in Pro with the Data Interoperability extension. Sorry for my confusion. Do I still go to their support page?
... View more
12-10-2020
09:47 AM
|
0
|
1
|
99
|
POST
|
Hi Again @BruceHarold, I am following your blog post Creating an FME Web Connection for your Enterprise Portal and am running into at least one issue: ...and in the Translation Log, I find this: Request to update access token failed. HTTP Error: HTTP/1.1 401 Unauthorized - https://myenterpriseportal.org/portal/sharing/rest/oauth2/token After I enter in my credentials, I get this window... I have used my login (admin), the login that I want to use (a resource account that is used for the Enterprise admin functionality). I have tried to enter usernames in 3 different ways - and the above window correctly displays the user name as seen in Portal. My Portal setup just uses our Active Directory for authentication and I do have the Single Sign-On experience working for our users. I do not allow anonymous user access and do not allow people to create built-in accounts. I only assign user seats through Active Directory. My full setup...: ArcGIS Enterprise (Portal, Server, GeoEvent Server) v10.8.1 ArcGIS Pro v2.6.3 Data Interoperability v2.6.2 FME 2020.0.1.0 (20200407 - Build 20218 - WIN64) Any thoughts on where to start looking for the issue? Thanks, --Adam
... View more
12-10-2020
09:11 AM
|
0
|
5
|
118
|
POST
|
Thank you @BruceHarold . I intend to keep using Pro since it is the way forward! Just bear with all of my questions....
... View more
12-04-2020
06:27 AM
|
0
|
0
|
107
|
POST
|
Okay - I think I got the 2nd part - just use an attribute value in the Shapefile Name parameter. THANK YOU @BruceHarold !!! That makes it incredibly easy. 👍 Back to the first part of the problem. I am aware of the case sensitivity, but didn't document that well in my question. The correct case in the field (all caps) is carried over from the Readers to the Transformer and also to the Writer when connecting them. Here is my view after following the steps in the training to connect everything (Yes, this is still me working in Pro - not as the training is done in Desktop v10.5): My connections before "Copy Attributes from Transformer" This is what the training says to do next: Instructions from Training ...and their example of what it is to look like when done: Training after instruction BUT - The following is what I get after I complete the step of "Copy Attributes from Transformer": My Result So, I get the attribute carried over from the Area section of the Transformer to the writer. I think I am seeing the lack of connection of the NAME attribute because the desired action of the "Overlayer" (actually incorporating the Area's NAME into the point data) is not happening automatically, as it must have done in previous versions of Desktop/FML? I then did a bit of hunting for an answer. Tell me if I found the right/best method to accomplish what I'm trying to do... Found in the PointOnAreaOverlayer Parameters - the "Attribute Accumulation" section and "Merge Attributes" which I set: Although I do not need the Point attributes added to the Area data - I DO now have the Area data's "NAME" attribute in the Point data - AND I am able to make the connection to the "NAME" attribute in the writer: ...and then make the connections... I'm wondering if: This is the best/most efficient way to accomplish this? If the older versions of software just assumed that you wanted this to happen, and made it work that way automatically? (Because the Overlay tool in Modeler did do that.)
... View more
12-04-2020
06:06 AM
|
0
|
2
|
110
|
POST
|
Hi Again, I am still working through the second ETL training (for older versions of Desktop) in ArcGIS Pro. Know that there are differences, but these are the only spatial data ETL trainings i know of. working with Pro 2.6.3 and FME 2020.0.1.0 (20200407 - Build 20218 - WIN64) Training: Controlling Data Translations Using Extract, Transform, and Load Processes | Esri Training Web Course Ultimately, I need to use the "Fanout" function of the Writer Feature Type. I have two Reader Feature Types feeding a PointOnAreaOverlayer, with its point output attached to a Point Shapefile Writer Feature Type. The first problem was figuring out how to duplicate the training's magical interconnection between all of the accumulated attributes listed in the PointOnAreaOverlayer and the Writer. I followed the instructions, but after using "Copy Attributes from Transformer", the "Name" attribute in the Writer had a red node and would not get data from the Overlayer when run. ("NAME" is the field in a polygon layer that must be captured in the point output.) I found the Overlayer's Attribute Accumulation - Merge Attributes and set the Accumulation Mode to "Merge Incoming". That allowed the Overlayer to show the polygon "NAME" attribute in the point attribute output list, and be visible to the point Writer. In previous versions of FME, this didn't have to be done? - Or more functionality forced additional layers of configuration? Now on to the real part of the question... I need to do a "Feature type fanout." Here is the Training pic of the simple checkbox and category picker within the Writer Feature Type Properties: Here is the Writer Feature Type Properties that I see in Pro/FME: Where is the Feature type Fanout functionality? Thanks, -_Adam
... View more
12-03-2020
11:26 AM
|
0
|
4
|
137
|
POST
|
Thanks for your response, @BruceHarold ! The second part - Would "Drop and Create" be my choice for the legacy "Drop Table First"? Thanks, --Adam
... View more
12-03-2020
05:50 AM
|
0
|
1
|
89
|
POST
|
Hello Everyone, I am trying to get off the ground using ETL processes. I have been impressed with some recent videos that I have seen and wanted to spend time learning more. I found two Esri trainings on ETL and immediately noted that they were both for previous versions of ArcGIS Desktop. I wanted to learn this in Pro, so I forged on in Pro. The first course wasn't too bad. I only found a few differences, but made it through just fine. Not the second: Controlling Data Translations Using Extract, Transform, and Load Processes | Esri Training Web Course (I am using ArcGIS Pro 2.6.3 and FME 2020.0.1.0 (20200407 - Build 20218 - WIN64) The first problem I run into is with Adding a Writer. In the Format section, I am told to use this specific format: format The only Geodatabase formats available are as follows: I believe that the correct selection would be the last one. Not sure, but I am pretty sure. The next part of the problem comes in another section of this training: When I look for the Drop Table First parameter, I cannot find it in the Geodatabase Writer that I have created in Pro's FME: If I open Esri's pre-made ETL tool that should mirror the result of my efforts by the end of the training section - and look at the parameters there, I see this: So - Esri Training's post-exercise completed example was probably created in Desktop 10.5. - I am using Pro. Am I just seeing the difference in versions, and the settings are right in front of my nose, and I just don't know how to interpret between the two - OR am I just completely lost?
... View more
12-02-2020
12:05 PM
|
0
|
3
|
113
|
Online Status |
Offline
|
Date Last Visited |
Friday
|