Things to avoid to avoid cognitive decline Cognitive decline affects one in nine adults in their mid-40s. Here's what you shouldn't do to avoid memory loss as you enter middle age.