My guess is that the data is actually larger than you think. For example, if you have polygon or line data, the number of vertices per line impacts the drawing, as each vertex has to be drawn.
What type of data do the layers reference? If you loaded in a shapefile, you can try the generalize data option when adding the layer to the map.
Can you share the URL of the web map here?
Mike