New Yorkers faced off against each other on the weekend as the issue of a 13-story Islamic center and mosque two blocks from the World Trade Center became more heated.

The proposed mosque drew hundreds of demonstrators on Sunday, with supporters and opponents alike carrying signs and shouting each other down.

Supporters shouted "Say no to racist fear!" while opponents played Bruce Springsteen’s "Born in the USA" at ear-splitting level.

With American flags waving on both sides, police had to separate the two groups, who continued to yell across the barricades.

Police officials said extra forces were deployed.

Opponents of the plan to build the $100 million Islamic center appeared to outnumber supporters.

"No mosque, no way!" signs were bolstered by others that simply read “SHARIA” in dripping, blood-red letters.

A banner was unfurled which showed images of beating, stoning and other torture which the banner bearers said were committed by those who followed Islamic law.

Opponents have demanded that the mosque be moved away from the site where nearly 3,000 people were killed on Sept. 11th, 2001.

TV interviewers, when eliciting opinions for the opposing side, were told: "They should put it in the Middle East."

One man said he remembered September 11th vividly, "seeing people jumping from the towers, and ashes falling on my house."

Some opponents have taken legal action against the construction proceeding, while some construction workers have launched a Hard Hat Pledge, vowing not to work on the project.

The mosque project is being led by Imam Feisal Abdul Rauf who has insisted the center will promote moderate Islam.

He has said the structure is architecturally plain and does not include a minaret, dome or other motifs associated with mosques.

The dispute, which has sparked national debate, has become an issue in the White House after President Obama said Muslims have the right to build the center at the site, although he was not sure whether they should.