One of the four North Korean defectors staying at a U.S. consulate in China will likely be refused entry into the United States.

A Seoul official said Friday that the U.S. Department of Homeland Security was opposed to granting asylum to one of the four defectors, citing the person’s alleged past involvement in human rights violations.

The official said that the Seoul government could accept North Korean defectors who wished but failed to secure asylum status in the U.S., with their concent.

The official, however, added that it is not decided yet whether the defectors at the consulate will go to the U.S. or South Korea.

The four refugees recently scaled a wall to enter the consulate compound in Shenyang, Liaoning Province from the adjoining South Korean consulate in the northeastern Chinese city.