Unfortunately, you do. You need a Torx (T20) screwdriver and take off the black acrylic plastic end, and the SD card is just beneath the push button.
When putting the screws back, turn them anti-clockwise to find the thread the screw has already cut, then it won’t need to cut a new thread for itself.