You can get your Minnesota fishing license (if you're 16 or older, you'll need one) at any license vendor, at a Department of Natural Resources Office, including some state parks, or online at the DNR website. Some species, such as trout and sturgeon, require a stamp or tag before you can fish for them.
Check out these Ellendale, MN fishing resources: