Firefighters from both sides of the border were called to Woodstock, N.B., Tuesday morning to battle a massive fire.

The blaze started around 10 a.m. in a two-storey structure known as the Rose Building, with businesses below and apartments above.

Justin Nye says he, his girlfriend, and their six-week-old son were all sleeping when the fire started.

“I just woke to some snapping. It must’ve been the electricity that was hooked to the fan,” said Nye. “I noticed it was really smoky so I just grabbed my son and left the apartment really quick.”

Firefighters from Woodstock, Hartland, N.B., and Houlton, Maine responded to the scene.

Woodstock Fire Chief Ricky Nicholson was the first to arrive. He says it quickly became clear that it would be a stubborn fire.

The chief and other firefighters quickly went through all the buildings at risk, trying to get people out.

“Some were grabbing for personal belongings and I had no time for that, some came out with no shoes on. It advanced quickly,” says Chief Nicholson.

The Canadian Red Cross says 19 adults and three children have been displaced. Some, like Justin Nye, have lost everything.

“We didn't get to take any of our belongings. I don't even have my shoes,” he said. “It’s going to be really hard for some people, but at least everybody is alive.”

Fire officials say at least three apartments and two businesses are a total write off. There's smoke and water damage throughout other historic buildings.

“It’s been renovated over the years, and dropped ceilings, which create a fire hazard and difficult to put out,” says Chief Nicholson. “We had to bring Houtlon's ladder truck to have the height because I knew within minutes that we wouldn't be able to control the fire.”

The loss of the businesses will be a blow to the downtown core.

“Just rebuilding is what we can hope for this,” says Lance Minard of the Greater Woodstock Chamber of Commerce. “We have a strong community here.”

The New Brunswick government closed the courthouse at noon. All court matters scheduled for Tuesday afternoon will be rescheduled to Friday.

Police say an emergency centre has been set up for people displaced by the fire. They can contact the Red Cross at 115 King Street or by calling 1-506-328-8881 or 1-800-588-4881.

With files from CTV Atlantic’s Nick Moore.