Paper studs.  Paper fasteners.

Paper studs, paper fasteners, brads. 

Whatever you call them, use them to join the layers of your invitations together or purely for decoration.

Also called push pins / split pins.

Don't forget to grab a Fiskars 1/16" hole punch to make the right sized hole for your paper studs.