Yes you can, sort of. You can't directly view the Feature Class (FC), but if you want to see what the data looks like in a map, you can convert it to a Spatially Enabled DataFrame (SeDF), and then plot that on a map in Jupyter Notebooks. Just keep in mind that your FC and the SeDF are disconnected. If you make changes to your FC then you will need to update the SeDF.
This is one way to do it that I use:
# import modules
import pandas as pd
from arcgis.features import GeoAccessor, GeoSeriesAccessor
from arcgis.gis import GIS
# create map
gis = GIS()
my_map = gis.map(location = 'San Francisco, CA', zoomlevel = 12)
# load your feature class into a spatially enabled dataframe (sedf)
fc = r'c:\gis\my_geodatabase.gdb\firestations'
my_sedf = pd.DataFrame.spatial.from_featureclass(fc)
# plot the sedf on your map
my_sedf.spatial.plot(map_widget = my_map)
# show the map
my_map