I was a libertarian at one time as well
. When my economic and political knowledge was rather limited. It was not the more nuance holes in theory ideology that pushed me away though.
Went to actual local libertarians meet ups and talked with actual libertarians, once I found out their beef with the Civil rights Act I was half way out the door. Then in my youthful ignorance I made the mistake of asking the classic "who gonna build the roads" question. The angry and exasperated response I got let me know that some of these dudes were not playing with a full deck.
Then I found out the Dems had the big booty female vote so I went to some local meet ups, I started to learn economics and too a African American history class and Lefty Rusty was born.
Also I once lived in Takoma Park MD, straight leftyville, I had legit communist for neighbors. And I remember one time I saw my Cuban still communist neighbor shoot a fair one with some Ron Paul supporters outside a food co-op. Fidel beat the breaks off ole boy, but Frederick called the cops
. I lost all respect for the ideology after that. You gotta be ideologically consistent, even when you getting that work.
As I have gotten older I have gained more respect for the ideology (somewhat, maybe for the pragmatist not the true believers) but I still see it as a path for white supremacy to go into overdrive.