The new Japanese prime minister is unlikely to back down from recent comments.