Yes, as we get older there do seem to be more moments when we can't remember something, but that's hardly surprising when you think about it.
The older you get the more information and experiences you've taken in and it doesn't seem odd to me that it would grow more difficult to pull a particular fact out of a increasing pile of other facts.
Today, take some time to think about that which you do remember now and want to keep remembering later. We humans have an amazing memory tool that you can use to great effect in this area – it's called writing. Plus there's that speech trick too, which is also handy.
– Label your old photos with who is in them.
– Take pictures of things with a story and write the story down to keep with it. Flickr and Vox are particularly handy for this.
– Talk into a tape recorder or an audioblog service like Hipcast or Odeo and tell the stories you remember for which you don't have physical souvenirs.
– Tell your stories in person to family and friends.
Most of all, though, don't give yourself a hard time over not remembering every single thing you've ever done, heard, read or otherwise encountered. It'd be a pretty poor & dull life that was always completely retrievable in every detail by a human brain. So just put the things that really matter to you in some form of "offboard" backup and relax.