Yes, as we get older there do seem to be more moments when we can't remember something, but that's hardly surprising when you think about it.
The older you get the more information and experiences you've taken in and it doesn't seem odd to me that it would grow more difficult to pull a particular fact out of a increasing pile of other facts.
Today, take some time to think about that which you do remember now and want to keep remembering later. We humans have an amazing memory tool that you can use to great effect in this area – it's called writing. Plus there's that speech trick too, which is also handy.
– Label your old photos with who is in them.
– Tell your stories in person to family and friends.
Most of all, though, don't give yourself a hard time over not remembering every single thing you've ever done, heard, read or otherwise encountered. It'd be a pretty poor & dull life that was always completely retrievable in every detail by a human brain. So just put the things that really matter to you in some form of "offboard" backup and relax.