@marcozehe Matrix is an open platform and there are a dozen clients available, some of which surely solve this problem.
For example there is a plugin for Weechat which is a text-only IRC client. You can connect to matrix.org through weechat and surely a screen reader could work with that.
Riot is only popular because it's the most feature-packed client, but it's certainly not the only choice.