of course some might argue that, if a security fence is errected around a building, but they leave one of the walls off, is walking through that missing spot breaching the secuirty?

Doubly so, if they never informed you that the building is sealed off, they just did it, and didnt expect you to be able to get in (or out)