Select to view content in your preferred language

AGOL Feature Date Store functionality

601
3
10-17-2024 09:08 AM
SaraJL
by
Frequent Contributor

Hello everyone!

So I might ask a duh question here - I'm trying to understand a little better how AGOL stores and hosts data. Since our AGOL organization was setup before my time at this job, I've never actually been involved with how that process works, so I understand functionalities but not necessarily how it's connecting on the backend.

My main curiosity at the moment is what the Feature Data Store on AGOL is doing. We have an enterprise/hosted AGOL site (SAML authentication) - and about 996 active accounts that all have a variety of data (mostly feature services, some tile services, apps, etc.). Nothing super huge, but there is definitely data stored on AGOL and daily user activity.

We have credits that are charged for storage, that part makes sense, but it's rare that our Feature Data Store is over 0%. I see spikes on the graph during activity, but then it will go back down to 0% quickly:

SaraJL_0-1729180646044.png

At 8am today, that makes sense because we were doing an activity on rendering data from CSV spreadsheets. But then it drops down to 0% again.

So this might be the duh question - what exactly does the Feature Data Store store? Data is obviously stored on AGOL, so is this just storing the data from processes at the time or during analysis (ie. like processes on a type of task manager) or is it something else?

GIS program wise - we only have one GIS class, but a variety of mapping projects are done across departments. The demand is growing, so I'm trying to get a better understanding of how the store is actually connected in the grand scheme of things. The documentation doesn't really super go into depth on the Data Store, so just curiosity on my part.

I hope that makes sense!

Thank you for the help!

0 Kudos
3 Replies
ChristopherCounsell
MVP Regular Contributor

ArcGIS Online storage is typically split into two components:

  • Feature storage (hosted feature layers, excluding attachments)
  • Everything else (attachments, imagery, tiles, files...)

The actual location of where this data sits varies but in the context of management, feature storage costs 200x more in credits as database storage is at a premium compared to the rest. You read more about storage and credit consumption here:

https://esriaustraliatechblog.wordpress.com/2021/06/22/which-arcgis-online-items-are-consuming-the-m...

https://doc.arcgis.com/en/arcgis-online/administer/credits.htm#ESRI_SECTION1_4E74456E44D84BFDB5A590B...

However the screenshot you have shown indicates you have a Premium Data Store. This offers fixed feature storage pricing and dedicated resources. e.g. up to 1TB of feature storage without credit consumption.

https://doc.arcgis.com/en/arcgis-online/reference/faq.htm#anchor7

I know this as you only get the Resource usage chart when you have a premium data store for your ArcGIS Online organization. This chart is an aggregator of several metrics. Marianne Farretta and her team made some great updates to it last year. Read more about it here:

https://www.esri.com/arcgis-blog/products/arcgis-online/data-management/tracking-your-premium-featur...

So in short:

  • You appear have a premium data store that allows for some dedicated feature storage (Hosted Feature Layers mostly) without credit consumption.
  • You appear to be well within the resource usage limits of your organization e.g. volume of requests, CPU, other processing. No concerns here.
  • You can probably move forward with conventional ArcGIS Online management like
    • What items are consuming the most credits in storage
    • Are we doing analysis in ArcGIS Online and what credits is it costing

Otherwise ArcGIS Online is pretty robust and I don't think you have any concerns around backend resource utilization, just if you'll burn through credits doing stuff like server-side processing or storing imagery for an entire continent.

Hope this helps and let us know if you have any specific questions.

0 Kudos
PeterKnoop
MVP Regular Contributor

While it used to be the case that you could only view a resource usage chart for Premium Feature Data Stores, it was made available (October 2023 update?) for Standard Feature Data Stores as well.

One way to determine which you have is to look below the "Feature Data Store" link you clicked on to open the chart. It should indicated Standard or Premium, next to the storage used value.

0 Kudos
ChristopherCounsell
MVP Regular Contributor
Ah, I made the mistake of checking with a personal subscription which
doesn't have it

The advice still largely applies except the free storage part.
0 Kudos