Cosing a pattern i'm working on with a background image deletes the reference image

Like, it shows up in the reference photo spot, but clicking the reference toggle just makes my screen brighter, can no longer work on project without painstakingly replacing the background image to where I already have beads placed T_T