Mrs. Jones said that we will have a fire drill at 8:45 on Thursday.

I am confused is what she said in quotes and should the word that be taken out - the instructions says to correct sentence.

The sentence is correct for an indirect quotation.

If it is a direct quotation, it should be

Mrs. Jones said, "We will have a fire drill at 8:45 on Thursday."