After some more digging I found some answers to that question.
In order to summarize what I found on some other pages, I'll quote everything here.
Here (Edaboard) I found following:
CAN transceivers are short circuit protected by design.
And here (Stackoverflow) I found some more information:
When you short these two lines, there will not be any voltage
difference and that falls under voltage range of Recessive bits. In
other words, Shorting two lines will be considered as continous
transmission of recessive bits.
When you transmit 6 or more consecutive recessive bits, it is
considered as Error! And when this error count goes more than 255,
Controller goes in BUS_OFF state.
As lines are shorted, there will be way more recessive bits and error
count will reach 255 in no time which will lead to BUS_OFF.
CAN protocol does have a "Bus Recovery Mechanism" in which it will
wait for 11 consecutive recessive bits for 128 times (Which it will as
bus is shorted) but again, same error frame thing will happen and it
will be back in BUS_OFF.
That's all I found, but I believe that answers it all.