Thread:VisualEditor/Feedback/Navigating via keyboard (without mouse)/reply

Have you looked at the keyboard shortcuts? Control or Command takes you to the link inspector. See VisualEditor/Portal/Keyboard shortcuts.

There are still some things that you can't do from the keyboard, like saving the page.