1. The train arrives in Chicago.

2. The train arrives at Chicago.
[Which preposition do we have to use in this case?]

#1 is best, but #2 is used, too.

2 would most likely be used this way:
The train arrives at Chicago's Amtrak station just before midnight.