I am certain you are not the only one who experiences these feelings.
What came to mind was a post regarding sexual imprinting. Just becuase a person doesn't have an innate attraction to one sex or the other, doesn't mean they aren't attracted to them from time to time.
But sexual abuse, whether it happens in childhood, or adulthood, really makes a mess of things. People find themselves attracted, if only intermittantly, to the gender they wouldn't usually date.
I would ask Joe Kort. I am certain he can give you a much better answer.
But I would say, no, you are not alone.
Just like those of us with SSA, you will have to decide how you want to handle those feelings ... act on them, or not, and develop strategies should you decide not to act on them.
Above all, be honest and true to yourself.
Acceptance on someone else's terms is worse than rejection.