Not Judging a Book by its Cover