A key element of pedophilia is a power dynamic or some form of conditioning. The rest is sort of physical preference.

I think the issue you have to reconcile is the fact that there are obviously adult women with child-esque secondary sex characteristics. Are they undeserving of sexual gratification because they are too child like? Is it really immoral to date a woman who is short or has non-existent breast/buttocks tissue?

If there are real physical scenarios where its okay, then the fixation on the physical elements of lolicon ought to be okay right? At that point its a body type preference like anything else.

Then lolicon has no power dynamic. Its either a fixation on a still image or other pornography. What's more, even if the fantasy is a power dynamic, that does not implicitly make it pedophilia.

It doesn’t matter if the lore says it’s 1,000 years old. It doesn’t matter if they’re based on a real person whom is of legal age. Liking someone sexually based on their childlike appearance is, at a minimum, pedophilia adjacent.

You haven't really justified why.

I'm not overly interested in defending this topic, but your are making some logical leaps that are unfair to the position.