if a simple page refresh fixes the problem, then your conditional enqueuing probably isn't the issue here. any errors in your browser console? as you only have few pages with audio, you could also exclude the mediaelements from autoptimization?
frank