Hi,
Have you checked this previous ticket?
(installation - Error while installing keras - Super User)
Is your python version up to date?
Did you also update pip via pip install --upgrade pip ?
Welcome to the PYNQ community.
Probably the Keras binaries for arm64 are not available in PyPI. Search online how to install Keras in Raspberry Pi with arm64, this will likely help you.
Mario