All perfect praise be to Allaah, the Lord of the worlds. I testify that there is none worthy of worship except Allaah and that Muhammad, sallallaahu ‘alayhi wa sallam, is His slave and Messenger.
There is nothing wrong with what you have done, and you are not liable for anything. This is because you have made a condition before putting on your Ihram. So you were allowed to end your Ihram for ‘Umrah and are not liable for anything. The Prophet, sallallaahu ‘alayhi wa sallam, said, "This condition frees you from liability before your Lord."
According to the wording of another narration, the Prophet, sallallaahu ‘alayhi wa sallam, said, "If you will be prevented (by something) or become sick, your dissolution will be by virtue of the condition that you made, and you are free from liability before your Lord." [Ahmad]
Allaah Knows best.