Does PCI apply to me if I only accept cards over the phone?

Yes. All businesses that store, process or transmit payment cardholder data must be PCI Compliant.