We present new practical local differentially private heavy hitters algorithms achieving optimal or near-optimal worst-case error--TreeHist and Bitstogram. In both algorithms, server running time is and user running time is , hence improving on the prior state-of-the-art result of Bassily and Smith [STOC 2015] requiring server time and user time. With a typically large number of participants in local algorithms ( in the millions), this reduction in time complexity, in particular at the user side, is crucial for the use of such algorithms in practice. We implemented Algorithm TreeHist to verify our theoretical analysis and compared its performance with the performance of Google's RAPPOR code.