Austin Gil explains some of the benefits of using SVG for your site’s favicon:

• Crisp image quality with a single file
• Support for emojis
• Inline icon (no need for a linked resource)
• Dark mode detection (sweet!)

Disclaimer: browser support is not amazing.