Well the people who play both KoL & Castlequest 2 are pretty much your target audience.
And if there's anything I know about Text game players is that a lot of them are purists. The thought of incorporating graphics into text games is sacrilege to them.
You COULD make it work if you make your game a surreal theme (like Undertale) or a horror theme mixed with different jump scares. That's the hot shit these days.
If you're going to make a fantasy game these days it HAS TO HAVE anime super deformed graphics with the sprites having oversized armor and Cloud Strife-sized swords. Those are the only ones I see that are getting marketed.
If this is just a passion project then go for it.