When is it okay to start a sentance with "but" in the english language?

In elementary and junior high school we were always tought to enver start a sentance with "but", and yet now I am in high school and I'm seeing it in books and ignments.