All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad is His slave and Messenger.
Apparently, the husband did not mean to describe the prayer as a problem or Museebah (misfortune); he was merely referring to the hardship of his wife when she has to go out of the house and pick up her daughter daily. If this is the case, then he bears no sin for saying that statement.
We would like to underline that a Muslim woman should, in principle, abide in her house; Allaah The Exalted says (what means): {And abide in your houses and do not display yourselves as [was] the display of the former times of ignorance.} [Quran 33:33] Therefore, she should not go out of her house without a need or necessity, and unless she adheres to the relevant Islamic guidelines. Please refer to Fatwa 82399 about the ruling on women working outdoors and the guidelines governing it.
If a woman is married, then it is impermissible for her to leave her husband's house without necessity unless her husband gives her permission to do so; please refer to Fatwa 130373.
Allaah Knows best.