How do I make water drinkable?

If I go to a stream and fill a gallon milk jug, then come home and bring it to a roiling boil, is it safe to drink? I am sure I should be worried about fertilizer chemicals and such, but I figure the further I get from populated areas the less of a chance there is.Should I be worried about anything else before I try this?