Hmmm, good question! When he sees Thor after just being 'restored' and getting his costume back and such, he does ask, "When did you get so old?" which definitely implies he doesn't remember everything (I always took it to mean he'd gotten his memories back but only up to the age he appears)...but it is Loki, so that might have been deliberate misdirection...