Drivers have been warned to expect delays this weekend, as millions of people head off for the early May bank holiday.