How To Take Back My Thumbs Up?

Many days back I couldn't find a way to take back my thumbs up that I added by mistake, the only way I could take it down its by doing a Thumbs down but doing that it registers it as a Thumbs down colour Red which I didn't want either, I just wanted to take back my thumbs up = Neutral like I didn't vote.

Is this possible?

Thanks a lot Kyatric for adding the Suggestion Request,

Have a good day mate :)