fourthly,he went fishing with his pal.

correct grammar.

"Fourthly" is not a word! Use something else: "next" or "finally" or something fitting.