John Stuart Mill, whose harm principle I have found wanting (e.g., here, here, and here) had this right:
If the roads, the railways, the banks, the insurance offices, the great joint-stock companies, the universities, and the public charities, were all of them branches of government; if in addition, the municipal corporations and local boards, with all that now devolves on them, became departments of the central administration; if the employees of all these different enterprises were appointed and paid by the government, and looked to the government for every rise in life; not all the freedom of the press and popular constitution of the legislature would make this or any other country free otherwise in name.
From On Liberty, Chapter 5
(thanks to Mike Rappaport of The Right Coast for the pointer)
Friedrich A. Hayek put it this way:
There is, however, yet another reason why freedom of action, especially in the economic field that is so often represented as being of minor importance, is in fact as important as the freedom of the mind. If it is the mind which chooses the ends of human action, their realization depends on the availability of the required means, and any economic control which gives power over the means also gives power over the ends. There can be no freedom of the press if the instruments of printing are under the control of government, no freedom of assembly if the needed rooms are so controlled, no freedom of movement if the means of transport are a government monopoly, etc. This is the reason why governmental direction of all economic activity, often undertaken in the vain hope of providing more ample means for all purposes, has invariably brought severe restrictions of the ends which the individuals can pursue. It is probably the most significant lesson of the political developments of the twentieth century that control of the material part of life has given government, in what we have learnt to call totalitarian systems, far‑reaching powers over the intellectual life. It is the multiplicity of different and independent agencies prepared to supply the means which enables us to choose the ends which we will pursue.
From part 16 of Liberalism (go here and scroll down)