This is complicated (there's a surprise!
)
In 1851 with Thomas and Elizabeth is Elizabeth Rathbone aged 7 and born Leeds but there is only a registration for a Sarah Jane Rathbone in Leeds. I presume this is Esther's child. There's also a Sarah Ann Rathbone listed, whose age I can't determine but looks as if it may be measured in months (possibly one month) and who doesn't seem to be registered as a Rathbone (maybe because this Elizabeth and Thomas were not legally married?). As they are all lodgers, I can't say these two are 100% connected to Thomas and Elizabeth, but would imagine they are.