It is a distortion of libertarianism by the Austrians that cleaves to this. Maybe an analogy would be appropriate here.

Martin Luther's idea that Faith Alone is cause for salvation is a concept widely embraced within Protestantism, along with another idea: that God helps those who help themselves. When taken to extremes, these ideas have been used as rationalisations for many who claim Christian faith as they turn a blind eye to human misery and suffering amongst them.

Yet does not true faith compel one to act? To ignore a human who the vicissitudes of life has thrown face down in the dirt, does not in any way advance liberty, nor is is a Christian deed.