I am mostly aphantasaic, but have no trouble at all remembering emotions.
The connection of aphantasia to strongly deficient autobiographical memory (SDAM) is well-attested now. You can find numerous clinical studies on the matter.
I am mostly aphantasaic, but have no trouble at all remembering emotions.