Was the first finely printed magazine devoted exclusively to the visual arts?

Yes, the first finely printed magazine devoted exclusively to the visual arts was The Studio, which was first published in 1893.