He does not care about you or your feelings or respect your boundaries. Being silent is not consent. You also explicitly said no to start.

What he did is not okay, regardless of it being labelled as rape or not. Frankly, I would say yes, you were raped. You did not consent and he went ahead with having sex with you.

I’ve just been thinking how he said he didn’t care that I said no.

You said no, then he ignored you saying no and proceeded anyway.

Just because you were silent, that does not mean you consented. He knows this and he didn't care.

You did not consent to sex and he did it anyway. I am so sorry this happened to you. Please talk to someone close to you and get away from him.

I haven't been in your situation so hopefully someone can provide better suggestions on how to proceed and process all of this.

Also, you are not to blame for not verbally saying no (after he ignored you the first time), trying to push him off of you or "fighting harder" to make him stop. Often times people will clam up, freeze and be in a state of shock to do anything. You said no and he proceeded anyway. You are in no fault at all - I'm sorry he did this to you.