A weak solution of organic dish soap, about 10-15 ml of soap per liter of water, thoroughly sprayed over the leaves and stems, should drastically cut the population. Regularly washing the foliage with plain water after that will encourage predatory mites to keep the populatiion down.

I was going to suggest same as ↑ It also indicates you need more air circulation around the plant. Give it some space.