You can ride an ATV on some private lands or some of North Carolina's national forests that offer designated OHV trails. Croatan National Forest, Nantahala National Forest, Pishagh National Forest, and Uwharrie National Forest all have miles of OHV trails for ATV use.
Check out these Boomer, NC ATV/OHV resources:
