Should we buy our perfect house even though it's on a busy road?

We have found a house (My boyfriend and I) and it is more or less perfect. It’s in the countryside on top of a hill with a long back garden which backs on to fields (the view is stunning because it’s up on a hill) conservatory, 3 good sized beds (all with fireplaces in), good sized kitchen with window view over the fields, good size lounge, enough off road parking for 5 cars, the location is perfect for us, everything we would want in a house BUT it’s directly onto a busy main road. There is an average of a lorry a minute going past plus a steady flow of cars (even at 9o'clock at night) it gets even busier at weekends. The house itself has double glazing and the walls are 9inch's thick so I doubt you would here much inside the house and 2 of the bedrooms are at the back of the house so away from the traffic. It’s just getting out the driveway is a problem because you can see down the road until the front of your car is on the road plus the noise aspect if we are outside. Also we are planning on having children as well and I am a bit concerned about bringing children up next to a busy road plus it means they will be confined to the back garden because they wouldn’t be about to play on the road. The primary school for the village is next to the road which has a 30mph speed limit (though not everyone sticks to this!) We are just both really torn because we love the house but we don’t want to buy it and regret it because of the traffic. Also worth mentioning the house has been on the market a year and a half though the house next door sold within 5 months because it was completely modernised throughout. Any words of advise?