Tried again to replace all the yen symbols, and weird enough I found out that delete didn't work, first time I thought the window was not focused, so I tried it again in all the other places where I have the symbol and basically I have to delete it twice!
It's like there is an invisible space after the yen, so I delete the invisible space, the cursor is next to the yen and nothing seems to happen, then when deleting again, the yen symbol finally go. I then pasted your yen and it worked fine.
I guess the problem is that I didn't type the yen from my keyboard, but always copied from the Internet and despite having copied it from several websites, it looks like every one have an invisible space after the yen.
Well, that seems sorted out.
By the way, how did you typed your symbol? I am on Linux, so I might not be able to type it in the same way as you, but at least this could be of help for others in the future.
Thank you again for your time and help!