This video is a full speed run through the game, so it's way too long. If you just want a taste of the weirdness, check this spot out.
The reason this game looks so glitchy is because it's not an emulator running on a Playstation 2. Instead, people reverse engineered the programming for the original Super Mario 64 and built a version to play on PS2.
Find even less sensible gaming stuff here.