Kasumigaseki Country Club currently only allows men to join the club
Golf is still trying to find its role in the Olympic Games.
After teething issues with the men's tournament, the women's event saw most of the world's top stars take part. South Korea's Inbee Park, the former World number one, defeated New Zealand's Lydia Ko (the current World number one) to the gold medal.
Despite the successes of the two tournaments in Brazil, golf at Tokyo 2020 looks set to take place at a golf course that bans women from becoming members of the club.
Speaking on Friday, Tokyo governor Yuriko Koike said she hoped that Kasumigaseki Country Club would allow women become members before 2020. "I feel very uncomfortable about women not being able to become a regular member in this era," Koike admitted.
Women are reportedly banned from playing at the course on Sundays, which could prove problematic in three years time, as tournaments traditionally end on that day.
Female membership of golf courses has regularly caused controversy around the world. Last year, Muirfield was taken off the rota of The Open courses, when it failed to allow women become members of the club.
Dublin's Portmarnock Golf Club currently does not admit female members, but in 2015 it was reported they were considering allowing women join the club.
The Rio 2016 golf course was purpose-built ahead of the Olympic Games, and will be used as a public course in a bid to attract new players. Kasumigaseki Country Club is a private course, and has hosted many professional events including the 1957 World Cup of Golf.