depends on which premises are leased !
Assuming you have leased JUST the upstairs, AND can get to the basement through a side door w/o entering their premises, they yes, you may go in w/o notice.
Assuming you did not specify it that precisely, then NO. Give 24h notice written notice and go in a day later !