The ink should come off. My OCD struggles with that stitching on the swoosh though.
For the ink, someone suggested cold water and a q-tip. I've also used a hairdryer before because the heat should activate/erase that factory ink. I don't know the science behind it, but it usually works.