You can operate an ATV on private land if you have permission from the land owner. You can only ride on public land that is specifically designated for ATV use. Look for the posted signs. Lewis County offers the state's only public ATV trails with over 400 miles of trails. A permit must be purchased. There are many commercial and club trails throughout the state as well.
Check out these Chappaqua, NY ATV/OHV resources: