Pipeline Run - History Report

[MattReeves_SpokaneValley]

I have a handful of Pipelines running to update data nightly & weekly. Is there a way to review these pipelines and see their run history, and their success or failure? It would be nice if this could be accomplished in a report, but even just being able to tell at the individual pipeline level would suffice.

[DuncanMackey · Accepted solution]

Hi Matt,

The best way to see all of your scheduled tasks and the run history for each is from the scheduled tasks page. To access the scheduled tasks page, navigate to the Data Pipelines gallery and click Manage scheduling. From here you can click on each of your tasks and view the past runs.

Give this a try, and please let me know if this doesn't meet your needs or if there is additional functionality you would like to see!

Thanks,

Duncan

[MattReeves_SpokaneValley]

Thank you for responding Duncan, 

Yes, this suffices for what I was trying to accomplish today.

That said, I could see benefit to being able to setup reporting that would summarize all of the Data Pipeline run results to one page, and possibly kick out to our ArcGIS Online accounts. Perhaps be able to set them up similar to the other reporting we can configure on other ArcGIS Online items/users/etc.

Thanks, 

Matt

[KentuckyDGI]

But what about just accessing the run history in general?  Other than tasks,  I see no way to find that info.  And from what I can tell, unless I copy the pipeline url at runtime I can't via python, which basically only lets you see if its running.  I haven't been able to find a way to view run history with python either.

[tmichael_wpjwa]

I agree, I think it would be good to have more visibility into the history for Data Pipelines.  Metrics for last run time, duration, result (success, failure), and some logging possibly.

This is a timely topic because something happened yesterday with a Pipeline that apparently caused it to run way longer than it should have, but I have no way to know which one or why.  And for this specific example it would be nice to know the actual credit charge per pipeline / per run.