Not 100% sure, but it might be Canadian Thistle. Does it have a lot of little thorns around the edge of the leaves? Nasty. Pull out as much of the root as possible. Otherwise, It will spread and just become a pain. Canadian Thistle is considered an invasive weed by Indiana.
I have agricultural grade weed killer that I bought from a melon farmer in Princeton, IN. That stuff will kill just about anything.
This reminds me that I need to get the preen put out early this year.
I have used roundup to remove all Johnson grass and 90% of the thistle on my 162 acres. Now I'm working on the multi flora rose, honeysuckle and locust trees, as well as the last of the thistle.