Whatever you do, your intention should always be for the good of people.
As long as the intention is good, you need not worry. The doctor when he uses a knife for the patient's operation , is lauded, whereas the robber when he uses the same knife to torment the householder to steal his wealth, is caught and punished. Here the knife is same, but the person who uses it and the intention are different.
As long as our actions help others to grow in life, we should not think otherwise.
So act with a positive mind-frame!