You sure have traveled!
For most of my life I would pick up a rock from every new nature place I visited. Mainly from mountains and beaches. I used to remember each and every one of them and where I collected them. One day about 5 years ago I opened up my handmade wooden box of rocks and couldn’t remember many of them so I closed the box and stopped collecting.
Should I have labeled them? I dunno. Maybe once I get my tipi grounds built I will use them to create a medicine wheel somewhere in the woods. The ones I remember I will place in a spoke pointing to the directions where I collected them.