https://community.esri.com/t5/data-pipelines-questions/how-to-handle-a-case-where-there-are-no-fields/m-p/1556721#M119 <P>Thanks for the feedback!</P> Fri, 08 Nov 2024 07:35:53 GMT AndreasHall 2024-11-08T07:35:53Z https://community.esri.com/t5/data-pipelines-questions/how-to-handle-a-case-where-there-are-no-fields/m-p/1554603#M115 <DIV>I have a scheduled data pipeline that once a day reads a JSON-file and writes it to a feature service. The file lists weather warnings (<A href="https://opendata.smhi.se/apidocs/IBWwarnings/objects.html#warningareas" target="_blank" rel="noopener nofollow noreferrer">SMHI Open Data API Docs - Warnings)</A>. Some days there might be no warnings at all present. Then my pipeline fails. Is there any way to handle this use case with ArcGIS Data Pipelines? (If there is no data several days in a row my scheduled pipeline is disabled as it has failed too many times in a row.)</DIV> <DIV>&nbsp;</DIV> <DIV><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="AndreasHall_0-1730443275833.png" style="width: 400px;"><img src="https://community.esri.com/t5/image/serverpage/image-id/118635iB241F803C2268C60/image-size/medium?v=v2&amp;px=400" role="button" title="AndreasHall_0-1730443275833.png" alt="AndreasHall_0-1730443275833.png" /></span> <P>&nbsp;</P> </DIV> Fri, 01 Nov 2024 07:55:22 GMT https://community.esri.com/t5/data-pipelines-questions/how-to-handle-a-case-where-there-are-no-fields/m-p/1554603#M115 AndreasHall 2024-11-01T07:55:22Z https://community.esri.com/t5/data-pipelines-questions/how-to-handle-a-case-where-there-are-no-fields/m-p/1554665#M116 <P>Andreas, I can supply an alternative workflow and have a blog on the topic which I'm publishing November 7th when ArcGIS Pro 3.4 releases - because it uses a new feature.&nbsp; The subject matter is weather alerts in CAP protocol, which I can see is available in your weather feed.&nbsp; Empty entries are OK.&nbsp; I'll let the pipelines team respond on what you are experiencing.</P> Fri, 01 Nov 2024 13:05:43 GMT https://community.esri.com/t5/data-pipelines-questions/how-to-handle-a-case-where-there-are-no-fields/m-p/1554665#M116 BruceHarold 2024-11-01T13:05:43Z https://community.esri.com/t5/data-pipelines-questions/how-to-handle-a-case-where-there-are-no-fields/m-p/1556576#M117 <P>Hi <a href="https://community.esri.com/t5/user/viewprofilepage/user-id/360655">@AndreasHall</a>,</P> <P>As you noticed, scheduling pauses when a data pipeline fails after too many failed runs (5), and this functionality was built in intentionally to prevent users from paying for the running of a data pipeline that may have a critical issue that needs to be remedied.<BR /><BR />We will work to address this in a future release and will reach out to you if we need additional input. <BR /><BR />Thank you!</P> <P><LI-WRAPPER></LI-WRAPPER></P> Thu, 07 Nov 2024 21:45:56 GMT https://community.esri.com/t5/data-pipelines-questions/how-to-handle-a-case-where-there-are-no-fields/m-p/1556576#M117 Sarah_Hanson 2024-11-07T21:45:56Z https://community.esri.com/t5/data-pipelines-questions/how-to-handle-a-case-where-there-are-no-fields/m-p/1556595#M118 <P>Hi Andreas,</P> <P>The empty JSON file is an interesting case, as Data Pipelines doesn't know the schema, hence the data pipeline failing. We'll look into some possible solutions for a future release. Thanks for bringing this up!</P> Thu, 07 Nov 2024 21:59:20 GMT https://community.esri.com/t5/data-pipelines-questions/how-to-handle-a-case-where-there-are-no-fields/m-p/1556595#M118 DuncanMackey 2024-11-07T21:59:20Z https://community.esri.com/t5/data-pipelines-questions/how-to-handle-a-case-where-there-are-no-fields/m-p/1556721#M119 <P>Thanks for the feedback!</P> Fri, 08 Nov 2024 07:35:53 GMT https://community.esri.com/t5/data-pipelines-questions/how-to-handle-a-case-where-there-are-no-fields/m-p/1556721#M119 AndreasHall 2024-11-08T07:35:53Z