I went last year knowing only a few words (thank you etc) and I got along fine, though I was visiting friends there. I bought the Rough Guide to Japan and that was pretty helpful for places to eat/visit etc. In Tokyo I really liked the Ginza, Shinjuku, Ueno and Asakusa districts. Senso-ji in Asakusa...