Super Mario 64 hacks are an N64 problem before they are a patch-format problem. The dump authors want is the US ROM in big-endian .z64 order. The n64decomp project states SHA-1 9bef1128717f958171a4afac3ed78ee2bb4e86ce as the file its build expects. I use that figure as the base check. A .v64 or .n64 of the same cartridge will not match, and converting it changes the hash on purpose. Do the byte swap first, then hash, then patch.
Formats vary by hack. BPS is the modern default because it checks the source. Older projects are IPS and will apply to the wrong order without a complaint. I am not printing a catalog of every SM64 hack. The research pass did not verify a hack-by-hack list, and romhacking.com is a directory rather than one author. If a page here linked every project, it would go stale the week it shipped. Bring the patch from the project you chose.
Emulator settings come after the file exists. Expansion Pak requirements, texture packs, and overclocks are not bytes the patcher sets. The N64 page says that once. This page only adds the hash. Usamune and other practice ROMs use this same base, which is why the hash appears twice on the site with the same digits.
Related pages: N64 byte order, BPS, Usamune, and the hack index. No ROM is offered here.