A former Minnesota youth pastor has been accused of fourth-degree criminal sexual conduct for allegedly having an inappropriate relationship with a 17-year-old member of his youth group.