Why erasing protects even a stolen phone

An attacker physically steals Alice's phone and extracts all the keys it contains. Explain why, thanks to the continuous erasing of old keys, the messages Alice sent last week remain unreadable nonetheless.