How does worshipping harm you?
When you worship you are putting someone or something up on a pedestal.
You are already setting yourself up for failure.
For when you see everything outside of you as being better, giving it more energy and making it untouchable, then you do not see yourself clearly.
Yes you can have passions towards something or someone. Yes you can care very much about something or someone outside of you.
But when you put so much focus on something outside of you, this causes problems.