The Commonwealth of Pennsylvania
Fun/Random English fact relating to PA:
The southern most border of Pennsylvania, the Mason-Dixon line, was surveyed in the mid 1760s by English astronomer Charles Mason and English surveyor Jeremiah Dixon to settle a dispute between William Penn and Lord Baltimore.
PS. Most residents just call it "PA" (Pee-Aye)
I'm not sure any other states go by their abbreviations