This sounds all too familiar. I once had a crush on a woman, who was well aware, and who flirted with me whenever she felt like it. She knew because it was written all over my face every time she'd walk in a room I was in.. can't hide a red face. She too was/is married and with children. She was completely out of bounds and for more reasons than one but it was hard to ignore those pestering feelings! What I discovered is this, all those emotions, anxieties, worries, akwardness, butterflies, etc were felt by me and only me. Despite the fact that she flirted (heavily, in my opinion) it was simply "just" flirting to her. She never had any intentions of crossing that line, nor did she care too. I was just this "cute girl" who stroked her ego.
My advice to you - your crush is unlikely going to care about what you said to your mutual friend. This is more played up in your own head than his. Forget about it .. the worries and anxieties. It's easier said than done but your story is not going to have any impact on him, his wife or your friends. Sorry to say (been there).