For science you may be interested in a book series called "The Best American Science and Nature Writing" which is published every year. From hundreds of essays/articles they select a couple dozen for each edition.

So you can read a wide selection from many sources and then go to those sources for more of what you like. Each year's publication includes a list of other "notable science and nature writing" of the past year, which are kind of like runners-up or honorable mentions.

The last three editions I read (2001, 2006 and 2014) included pieces from some of the magazines you listed as well as others like Orion and The Smithsonian plus less-obvious sources like Harper's and The New Yorker.

Unfortunately in my experience these anthologies do not have much on mathematics.