oil stick

Hi, The end of my dispstick broke into the tube while pulling it out. The piece fell in probably in the oil pan I guess. Will it go through the oil pump and cause issues or am I ok for now? How do I remove the piece and how hard is it? Anyone had this happen before? Thanks