Ruchika,Remember you have been treading on a thin ice and a very thin for that matter.
Having a sexual relation within the family could be comfortable at times but then again such relations does not or could not be kept hidden for long from the family.
Think of your husband and family before going on doing it. All the reputation you have got all these days would be lost for a pleasure of couple of minutes.
He for that matter does not have anything at all to loose. And if found you would be held responsible.He is having a field day with a free screw that too very easily at home without bothering to look for a safe place and a woman too.
Do you really believe that he have not sensed by this time that you just have been pretending all the time and have been enjoying it as much as he did or does?
Do not fool yourself you willingly and with consent let it happen what has been happened and in future you would let it happen as forbidden fruits are always sweeter.
So its your life and you both are adults so take a wise call!