Kim Davis, the defiant Kentucky county clerk, was found in contempt of court and taken into federal custody.

U.S. District Court Judge David Bunning ordered Davis, the Rowan County clerk, to be jailed on the contempt charges until she agrees to comply with multiple court orders to issue marriage licenses to same-sex couples.

The judge ordered her held indefinitely because he did not believe fines would be enough to compel her to follow the law.

Her office refused to issue a marriage license to a same-sex couple as recently as Thursday morning, before Davis and her staff closed the office made the half-hour trip from Morehead to Ashland.

Davis, an elected official and Democrat, has argued that she should be exempt from following the U.S. Supreme Court ruling in Obergefell v. Hodges because she objects to same-sex marriage for religious beliefs.

She has asked the judge to delay his ruling until the Kentucky state legislature, which won’t be in session again until January, can pass legislation that would exempt her and other clerks who don’t wish to follow the law.

Gov. Steve Beshear, who leaves office at the end of this year, has said he will not call a special session on the matter because it’s a waste of taxpayer money.

But Kentucky’s Republican Senate president said the Supreme Court ruling in June invalidates nearly all of the state’s laws governing marriage and the process for obtaining a marriage license.

“The General Assembly will be compelled to amend many sections of Kentucky law, not just for the issuance of marriage licenses, to comply with the recent Supreme Court decision,” said Robert Stivers, the Senate president from Manchester.

Four couples have sued Davis, and they have asked the federal judge to punish the county clerk by imposing fines against her, saying that she continues to draw a taxpayer-funded salary “for duties she fails to perform.”

Her attorney from the conservative Liberty Counsel argued Wednesday that Bunning should not punish her for disobeying his order because issuing a marriage license to a same-sex couple would “irreparably and irreversibly violate her conscience.”

“It is not as if Kim Davis the individual stops existing while Kim Davis is performing her duties as Rowan County clerk,” argued attorney Jonathan Christman.

Her attorneys argued that Davis should escape punishment for now because she has an appeal pending on a related issue, and they also argued that she has a right to a jury trial to determine whether she should be punished.

However, the top federal prosecutor in Eastern Kentucky said it was time for Davis “to follow the law,” arguing that she had presented her arguments “through the federal court system, all the way to the U.S. Supreme Court,” and lost each time.

“Government officials are free to disagree with the law, but not disobey it,” said U.S. Attorney Kerry Harvey in a statement.

Legal experts said it was unusual for a U.S. attorney to speak out on a case that does not involve his office, but they said federal prosecutors have a “vested interest in having federal court litigants comply with court orders.”

Bunning, the son of former U.S. Sen. Jim Bunning (R-KY), was appointed to the federal bench by former President George W. Bush and confirmed by the Senate in 2002.