I think you need to let fontconfig know about those directories via a configuration file.
My understanding is that you should have a file named texlive-fontconfig.conf somewhere in the directory tree. Otherwise it's here.
Create the file
and give it the contents of texlive-fontconfig.conf.
What worked for me was was to go to
Menu → language settings
and install "full support for urdu language".
Then, in the Firefox browser, go to
Preferences → General → Language → Choose your preferred language for displaying pages
and change Latin to nafees.