Silly Billy, by Anthony Browne

Billy is a bit of a worrier. He worries about hats and shoes. Most of all he worries about staying at other people's houses. His mum and dad try to help, but still Billy worries, until a visit to his grandma's shows him how to overcome his fears with the aid of his imagination - and some tiny worry dolls.