Working in a solitary silo is just as bad as team silos. Part of the job of a designer is to bring people with you. Listen to everyone. Engage everyone. Meet with them and show them your iterations. Your mood boards. Your ideas in rough, ugly, unpolished form. This may make more work for you. It will make more work for you. But it will make better work and it will make others want to work with you.