[core] remove callbacks before stopping tcp protocol layer (#1693)

[core] remove callbacks before stopping tcp protocol layer (#1693) #5884