The Army Corps spillway below Caesar Creek Lake cut straight through Ordovician limestone and left one of the richest, most accessible invertebrate exposures in the Midwest. You need a free permit from the visitor centre, there is a size limit (roughly palm-sized), and it is surface collecting only, no digging or hammering the bedrock. Isotelus, Ohio’s state fossil, comes out of here.
Brachiopods, bryozoans, trilobites · Ordovician, ~440 mya
See it on the map
Other places on the map within a couple of hours.