Drivers door catch problem

Something has come adrift in the door, the inside handle is all loose and no longer works, opens fine still on the outside and locks as normal

Quick look behind the inside handle and I can see the wire connector but not get at it. Do I need to take off the outside handle to get access to reattach things or am I going to have to take off the whole inside panel?

Reluctant to try in case I make things worse!