I think the problem lies in how to relate or think about the ultimate authorities. Monotheistic religions have doctrines as to how to think about God, and how to relate to Him. People have problems with that dogma for various reasons.

I was briefly Roman Catholic until I realized that I was Polytheistic. And that it was o.k. to be Polytheistic. Then I had to go through the process of learning about Polytheism.

However, you did pinpoint a problem in Neo-Paganism of the individual deciding what they will believe and do. It is a human centered religion.