Staples: in the trash.
Paperclips: throw away one or two "by accident."
Binder clips: only the Devil would put a binder clip in the garbage can.
Hence:
When you clear off your shelf every coupla months, spend an hour sorting and reclaiming the hardware.
Or get an intern to do it.