I have four boys who range from wanting just the odd ear rub, to can't get rid of him, but have never had female cavaliers. The boys are more affectionate than my female springers were, though.
The sex topic was discussed among another cavalier group and most people prefered dogs; even show people, because the males keep their coats better. Of coure, this wouldn't apply if the female was spayed. People who prefered bitches tended to be those who had only had experience of bitches or those who didn't like boys' rude bits.
I think you lose your preference for certain colours as you meet more cavaliers. At first I only liked Blenheims or tris, avoiding rubies,as Monty's breeder said she found them less robust. The few black and tans , I'd seen, had the type of eyebrows which made them look grumpy, so I didn't fancy those either.
Having met or seen lovely examples of all four colours, I would now happily have any one of them. Oddly, since speaking to Monty's breeder I have only seen chunky rubies and none of the little fragile ones.