According to Weebly you may access pure HTML/CSS to change your site in any way you like.
According to Wikipedia, this is the way to integrate a favicon in the header of HTML (after having created and stored "favicon.ico"):
<link rel="icon" href="http://example.com/favicon.ico" type="image/x-icon">
(Note: Internet Explorer needs rel="shortcut icon")
Hope it helps.