Eleven Secret Service agents were recalled to Washington last week after nearly all of them allegedly brought prostitutes back to their rooms at a luxury hotel in Colombia.
The team was in the country to scout out the security situation ahead of President Barack Obama's trip there for the Summit of the Americas this weekend.
But the agents - who have now been placed on leave - reportedly capped off a week of heavy drinking at the beachfront Hotel Caribe in Cartagena by cavorting with prostitutes.
The partying was exposed when one of the women caused a commotion after an agent refused to pay her. Local police and hotel security were called.
Luxury retreat: The 11 recalled Secret Service Agents were staying at the Hotel Caribe in Cartagena, Colombia
Security breach: Experts say the agents' behavior could have endangered the president, though the White House says that was never the case
Five U.S. military personnel, who were working with the Secret Service, could also be involved in misconduct and have been confined to their rooms and ordered not to have contact with others. They face possible disciplinary charges.
Rep Peter King, who was briefed on the incident, said 11 agents, many of them married, were in the team that was recalled to the U.S. - instead of 12 as originally reported - and that 'close to' all of them were involved.
Mr King said he was told that anyone visiting the hotel overnight was required to leave identification at the front desk and leave the hotel by 7am.
When a woman failed to do so, it raised questions among hotel staff and police, who investigated.
They found the woman with the agent in the hotel room and a dispute arose over whether the agent should have paid her. Mr King said he was told that the agent did eventually pay the woman.
The incident was reported to the U.S. embassy, prompting further investigation.
In the field: The agents were in Colombia the week before President Obama's arrival to the Summit of the Americas
Beachfront property: The Hotel Caribe is a luxury resort that costs about $160 to $200 per night
During their week-long stay at the five-star hotel in Cartagena, the agents were seen drinking heavily, according to waiters there.
A number of the White House staff and traveling press corps were also staying at the hotel.
The White House said Mr Obama had been briefed about the incidents but would not comment on his reaction.
'The President does have full confidence in the United States Secret Service,' presidential spokesman Jay Carney said when asked.
Mr Carney insisted the matter was more a distraction for the media than Mr Obama. But Secret Service assistant director Paul Morrissey said in a statement: 'We regret any distraction from the Summit of the Americas this situation has caused.'
The Washington Post reported that Jon Adler, president of the Federal Law Enforcement Officers Association, said the accusations related to at least one agent having involvement with prostitutes.
The association represents federal law enforcement officers, including the Secret Service.