The entire event was caught on camera. Initially, I even tried to back up a bit so he can move his car to his left where there was ample of space but he wouldn't budge. I indicated to him to see if he can move to his left by hand movement but still, he wouldn't move. I was eventually forced to back up even more by another car. If it helps, in the last few seconds of the clips the gentleman in the red car pointed his hand and told me it was the other car's fault. What would you have done?
Here is the youtube link to the video - https://youtu.be/qRdPB3Tjl-4
It was really weird. I guess as you are the only one going to one direction and the other side have 4 cars you may be the one who need to give way. Perhaps I was wrong.