Two more areas outside Tokyo will ban fans from attending Olympic events because of the rising coronavirus outbreak.
Tokyo organisers and the IOC earlier in the week barred all fans from venues in Tokyo and three neighbouring areas.
They make up the overwhelming majority of Olympic venues, although a smattering of outlying areas were allowed initially to have limited attendance.
All fans from abroad were banned months ago.
Now, two more areas that were permitted to have fans have backed out of those plans.
The Fukushima prefecture in north-eastern Japan has decided to hold its baseball and softball events without spectators.
It has been joined by the northern prefecture of Hokkaido, which will hold soccer games without fans at the Sapporo Dome.
"Many people including children have been looking forward to the Games, and I'm very sorry to take away their chance of watching baseball and softball at the stadium," Fukushima Governor Masao Uchibori said on Saturday.
"It was a very tough decision to make."
Fukushima was the early focus of the Olympics, trying to shine a light on recovery efforts in an area devastated in 2011 by an earthquake, tsunami, and the subsequent meltdown of three nuclear reactors.
A few other events being held in the outlying prefectures of Miyagi, Shizuoka and Ibaraki will go ahead with limited spectators, organisers said.
About 40 people staged an anti-Olympic protest outside the five-star hotel where IOC president Thomas Bach is self-isolating after arriving in Tokyo on Thursday.
Polls have shown between 50 to 80 per cent of Japanese oppose holding the Olympics.
Tokyo registered 950 new infections on Saturday, the 21st straight day that infections were higher than a week previous.
It was the highest since 1,010 were reported on May 13.