TOKYO - Japanese Foreign Minister Koichiro Gemba said Friday that Japan's ambassador to South Korea would temporarily return in protest against South Korean President Lee Myung Bak's visit to disputed islands.