I am not an expert but I love clematis and I find it happens to all the summer flowering variety to a different extent .

If you've had the plant for more than a year and didn't prune it back in February, that's why the base is brown. This variety should be cut back to about 2 buds, or around 8 inches, from the base in January or by mid-February each year.