Here is a screenshot of some of the icons and their duplicates
If I move the actual file, the dummy stays where it is until I either restart the PC or restart gnome desktop by pressing ALT + F2 and typing restart which causes the dummy file to be back under the original. The dummy files are slightly smaller than the original, and are overlapped by the original.
After updating from Ubuntu 20.10 to Ubuntu 21.04 I've noticed that all the files on my desktop have duplicated themselves, but the duplicate version cannot be opened or interacted with.