https://community.esri.com/t5/arcgis-enterprise-questions/large-dataset-best-practices/m-p/1362538#M38041 <P>Hello,</P><P>We've got an inspection dataset that spans multiple years. The inspectors collect 30-40k points every year with photos and for example our last year the dataset was 6GB in size. We must maintain at least 7 years worth of data, so +40GBs.&nbsp;</P><P>This data needs to be displayed in several local enterprise map products, including dashboards and webmaps. I think user functionality would be best served as one large dataset, as they want to be able to filter and create reports based on multiple years.&nbsp; I have concerns over the network resources required to serve that up.</P><P>For accessing the data, i.e. speed and reliability is it better to maintain one large dataset or multiple smaller ones? Hosted vs referenced? Any particular setup options I should be aware of?</P><P>&nbsp;</P><P>&nbsp;</P> Tue, 19 Dec 2023 15:06:06 GMT Jol1234 2023-12-19T15:06:06Z https://community.esri.com/t5/arcgis-enterprise-questions/large-dataset-best-practices/m-p/1362538#M38041 <P>Hello,</P><P>We've got an inspection dataset that spans multiple years. The inspectors collect 30-40k points every year with photos and for example our last year the dataset was 6GB in size. We must maintain at least 7 years worth of data, so +40GBs.&nbsp;</P><P>This data needs to be displayed in several local enterprise map products, including dashboards and webmaps. I think user functionality would be best served as one large dataset, as they want to be able to filter and create reports based on multiple years.&nbsp; I have concerns over the network resources required to serve that up.</P><P>For accessing the data, i.e. speed and reliability is it better to maintain one large dataset or multiple smaller ones? Hosted vs referenced? Any particular setup options I should be aware of?</P><P>&nbsp;</P><P>&nbsp;</P> Tue, 19 Dec 2023 15:06:06 GMT https://community.esri.com/t5/arcgis-enterprise-questions/large-dataset-best-practices/m-p/1362538#M38041 Jol1234 2023-12-19T15:06:06Z