I tried and searched...please tell me there's a simple way to update the favicon in Joomla 4 ? That there is a hidden upload button somewhere that I didn't find that will allow anybody to custom the favicon ?
I tried this : docs joomla on favicons , so to add a file name "favicon.ico" in my template who is set as default, without any success. I tried to delete all the cache and open it on a private navigation window. Nothing has changed.
Then I tried to replaced the "favicon.ico" in the "media/system/images". I was surprised it didn't work, but well ..
Then I tried to replace the "joomla-favicon.svg"...and then it worked ! But...why ???
And also...Do I really have to go in my "index.php" from my child template to kill those lines : (~line 25)
$this->addHeadLink(HTMLHelper::_('image', 'joomla-favicon.svg', '', [], true, 1), 'icon', 'rel', ['type' => 'image/svg+xml']);
$this->addHeadLink(HTMLHelper::_('image', 'favicon-new.ico', '', [], true, 1), 'alternate icon', 'rel', ['type' => 'image/vnd.microsoft.icon']);
$this->addHeadLink(HTMLHelper::_('image', 'joomla-favicon-pinned.svg', '', [], true, 1), 'mask-icon', 'rel', ['color' => '#000']);
and add link manually the new favicon ?
And why would joomla name a favicon "joomla-favicon.svg" and "joomla-favicon-pinned.svg" not name them all favicon so we can replace them more easily on each support ?

First create a child template so we don't have to touch the core files. Create 2 square SVG icons and and a favicon.ico (32px x 32px).
The default Joomla SVG favicons are a good reference to start with. The are located in media/system/images
Upload the files to media/templates/site/name_of_child_template/images
In the backend of Joomla go to system -> website template styles and make your child template the default. The favicons should now be changed to the new ones to the ones in you child template.
Alternatively you can use the Phoca Favicon extension. https://extensions.joomla.org/extension/phoca-favicon/