This problem is demonstrated with two polygons with either a value of Yes or No. Yes is visualized as green and No visualized as red. When I change the values in the web map, the polygons change colors instantly. When I change the colors in a Web AppBuilder for ArcGIS, the colors do not always change. If I zoom in and out, they may change or may not which corresponds to Yes and No value seeming to have a different value at each zoom level. See attached.
Repeating myself, if I just use the web map, it works fine.
I created the same data, web map, and web app on a different AGOL organization account and it works fine there. What could be going on?