I would totally agree with you! I have been using Linux since six years ago, and the more you get into it, the more you like it.
Yes, the first times I used to try it beside windows, I have always been leaving it and continue using windows again, and I would say that happened to me and many of other Windows fanboys for three reasons:
1- The Linux World Entrance distribution that most of people recommend which is Ubuntu or Linux mint; I agree they have support and easy to use, yet they are not the best of linux and to my experience, I have faced many bugs while using Ubuntu, such as freezing, lags, problems in booting, so I don’t use it much and quickly change it to another distro.
2- Linux Guideline, a new linux user needs a basic intro to : how to use it, how to use basic terminal commands, ways of installing applications.
3- The beautiful interface, I would blame the linux UI teams who work of desktop environments like KDE, Gnome and Unity before..etc, for not showing the real beauty of linux, I remember whenever I wanted to install Gnome DE which or Ubuntu, I would take couple of hours to customize it and install the proper theme and icons, they should really play hard on this, yes KDE for example started playing on that, but others still.
Lastly, the best thing in linux is that YOU CAN ALWAYS MAKE IT AND USE IT AS YOU WANT AND FOR THE PURPOSE YOU WANT.
You can change its look, you can use it for any purpose, and there are always alternatives for what you want to use of windows softwares.
And yes, different distributions have different purposes and different performance, to me, a good alternative to Ubuntu is Manjaro.
But the best distribution of all is Arch Linux.