Your Past May Be Lying to You