Navigate library using keys - macOS

I would like to move around the library with keys e.g. up/down arrows and page up/down.Even if I have the focus on the currect pane e.g. highlight a book the arrow keys affect the left pane only,