The actions menu stops working after playing a while.

Some times when I have the game running (don't know exactly how long) I am unable to open the actions menu with X on my Xbox one controller.
Most of the time when I open a box or chest (any container), I am unable to get the actions menu to show.
I opens and closes really fast when I press X on the controller.

I usually fix it when I reload the game or save.