This is so weird that I do hesitate to tell it.
The shadow problem suddenly went away.
I added a pointlight into the scene for some test and then removed it so the scene became same as shown.
Now to the spooky thing. The shadow artifacts are gone. Same scene, same lighting, same settings.....
So good for now ... eeeh... I think