IMO it is what you use the phone for and how you use it is really what matters. Out here in the real world who on earth cares that one phone is 300ms faster than the next? As soon as you buy a phone it is already out of date with better ones already being made. For an example look at those rushing out to buy 4k TVs when 8k is already available and 16k already being made. It is a never ending quest you just cannot win.
In saying that I moved from a Samsung Note 3 to a Lumia 930 a few months ago. The biggest thing that turned me off Android was updates, dozens every day which also impacts on downloads and battery life. Updates are totally chronic, all day every day. I did not use apps like Google play books or movies or music or any of that stuff, I desperately tried to uninstall this rubbish but as quick as you could blink it was self installing again, and of course updating.
IOS? Yeah forget about that iPhone/Apple garbage that is so dictatorial in everything it does. Why does Apple have the need to have big stores everywhere? Because that stuff is so difficult to use everyone has to continually visit the store for lessons.
WP is just so easy to use, I use Windows 8 at home and work and I am lucky if I get half a dozen updates per week. It does everything I need it to do, all the apps I use are available and it just integrates with my computers and laptops and Xbox One. I did go down a fair bit in screen size for now but new larger screen WPs will be coming later this year. I also wear glasses for reading and WP allows me to use it when my glasses are not available.