Yes. If it can't convert the string into a number, the conversion will fail. You need to strip out the character:
# NewField =
convert(!OldField!)
# Code Block
def convert(x):
try:
x = x.replace('"', '')
return float(x)
except:
return None
Have a great day!
Johannes