You probably need to get busy with the fungicide, Lily. You'll have to read the labels to see which one is appropriate. Annie

I have rust on some of my hollyhock, I remove heavily affected leaves and have learnt to live with it as the flowers seem just as good with or without the rust. You can get some that are more resistant to rust than others.