Yes, it’s true. The amputated arm received its own burial and marker. Read the story at Atlas Obscura. Incidentally, Stonewall Jackson was a devout believer. It’ll be interesting to know what happens to his arm at the resurrection.