I am working with QGIS 3.16.0 and I have a raster layer (A) consisting of 2 values: 1 is where there are olive tree, 0 is where there are no olive trees:

I have the second raster (B) classified the same just for a smaller area:

I need the areas of the first raster non overlapped by the second raster, so I applied raster calculator : (A) - (B), however, I did not got the difference of these two rasters, I got this result:

Which is the same as the raster I subtracted and not the difference of the two layers.
What am I missing here?