Is it possible to include a header and footer file using HTML?

I have my file as a .html and need to be able to include the HTML for the header and footer.

Anyone know how I can do this?