I'm figuring out how to deal with organizing random/miscellaneous GIS data consisting of shapefiles and file geodatabase. The goal is to create an GIS data catalog app (ArcGIS Experience Builder) that allows user to download data and search the data by filtering or through area of interest. The challenge is that the data won't be published or added as referenced data at ArcGIS Enterprise Portal or hosted via file server. My idea was to create a Python script that find the data stored inside a network file share through path > zipped it and save it in ArcGIS Server output directory > users download it through URL.
Is it even possible? Or is there a good practice in dealing with lots of GIS data that are unpredictable in how frequent they are added and updated?