In the navigation, you have application title and application icon. You must set this.
NOTE: this is for the latest version of Mendix (I see that you mentioned 9.8.2 as Mendix version)
For older versions, indeed you must change the html file and add it via link tag.
This question has been asked on the forum before, Please check link.
Might help you.