Im not a doctor so take my answer with a giant boulder of salt, but it's possible while still unlikely. Most of the time it just results in fetal death before implantation.

Most studies on irradiated sperm are done on flies, mice, and cows. In the cows, the irradiated sperm just couldn't get the job done. The radiation would affect the maternal chromosomes and end up in fetal cells not growing or even diminishing. In mice it was closer to what we see described in the book, with paternal chromosomes disappearing from the equation - leaving maternal dna to either fill the spot on the dna sequence or leave it empty. If there are no chromosomes to fill that spot, the embyro didn't get whatever vital function came with it, and it won't likely move on to the next stage of growth. The same goes for chromosomal duplicates.

Because human sperm testing is strictly voluntary and often done in privacy, we don't have a lot of public data on that. I imagine theyre sturdier than mouse sperm but less so than bovine? Again im not a doctor so idk.