UMG While Hovered over a Button Use Keyboard Input To Do a Function

A very easy way to explain what I am trying to do is. if you have every played Ark Survival Evolved, then you know what type of inventory I am trying to make.

if you have not played that game. I am trying to get a button or a border does not matter which one I use, it get it to work. I went with the button because it already has the on hovered built in. I have built an inventory system. My Inventory slots are generated by a function to populate a grid panel.
When I open the inventory and it focuses on that widget its hard to get any key board input to work.
But I would ready like some help here on this one. While the mouse hovers over one of the inventory slots I want to press a key and it to use the hovered slot ( by calling a function of some sort)

I can get it to do what i want by clicking on the one i want to use then pressing E but on hover. even know i have use the on hovered function. i have not even got an on clicked.

I think maybe by clicking on the slot i am the putting that widget in to focus then its doing actions. any one get any ideas