Conger and Bentz were removed from their flight from Rio de Janeiro to the United States Wednesday night by Brazilian authorities, US Olympic Committee spokesman Patrick Sandusky told CNN Sports contributor Christine Brennan.
The swimmers have since been released, according to the USOC, with the understanding that they will continue discussing the incident on Thursday.
The athletes - Ryan Lochte, James Feignen, Conger and Bentz - reported being robbed at gunpoint early Sunday in a taxi bound for the Olympic Village by individuals posing as armed police officers, the US Olympic Committee said Sunday.
Brazilian authorities said they have questions about what actually happened that night.
Authorities are concerned about inconsistencies in their reports.
Civil police say the case attracted attention because the victims said their phones and watches hadn't been taken -- items that would be a prized target for thieves in crime-plagued Rio.
