Because... he got too attached. He was concerned about what would happen if he left.

[From his muffled tone, it's clear that yes, Shiro is aware of how stupid this idea is, said aloud.]

So. To him... leaving on his own would be better.