Alex Witze has a delightful story about Jim and Jenny Marshall, who are collecting all the elements:

In their townhouse in Denton, Texas, chemistry professor Jim Marshall and his wife, Virginia, have compiled perhaps the world’s only collection of every element from hydrogen (atomic number 1) to uranium (atomic number 92).

Not content with that, they have also traveled to most of the places where each element was discovered, bringing back a sample of the original minerals.

The Marshalls also have a web page documenting their adventures.