"But it has not had a big impact on popular culture."
And according to this list it says that it could be considered the best game of all time.
Not to mention the number of platforms this game is in (Nintendo Switch, PS4, Xbox One, just to name a few).
You can find more information about Minecraft having a big impact on popular culture on the Cultural impact section of the Wikipedia page for it.
I myself have never played it, nor do I know anybody that does, it is not the kind of game that people I consider gamers would play, but that is more a matter of different times, ages, etc. Gamers nowadays are a different group than 20 years ago. (I think apps becoming available has played a big part there, introducing people that normally would never had played any kind of game to games. Playing videogames or atleast game apps is so much more mainstream now)
But I am getting off track. First part was "agreeing" that I don't know people that play it either, I think it is more a game for the new generation gamers, under 30ish.
Second part would be disagreeing. Impact on popular culture, seriously when thousands of people go dress as something from minecraft for halloween, surely it has made an impact. I think in 1 year more people dressed up as minecraft than people in the past 25 years have as mario.