do we need to calculate z in order to use the critical value like we did when we calculated the p value?
If you are running a hypothesis test using a null and an alternate hypothesis, then yes, you compare a test statistic to a critical value to determine whether or not to reject the null. You then draw conclusions on your findings.
I hope this helps and is what you were asking.