At the moment MYSQL only goes up to 8.0.36 on AlmaLinux 8 and I needed to install 8.0.40 – grabbing the official rpms and doing it manually was the only way that worked. Install net-tools, grab the rpms, install, start the server again and enable it at startup – note that your /etc/my.cnf will probably be replaced by this upgrade so check for any missing custom parameters, the old one will be called something like my.cnf.rpmsave
dnf -y install net-toolswget https://downloads.mysql.com/archives/get/p/23/file/mysql-community-server-8.0.40-1.el8.x86_64.rpm
wget https://downloads.mysql.com/archives/get/p/23/file/mysql-community-client-8.0.40-1.el8.x86_64.rpm
wget https://downloads.mysql.com/archives/get/p/23/file/mysql-community-common-8.0.40-1.el8.x86_64.rpm
wget https://downloads.mysql.com/archives/get/p/23/file/mysql-community-icu-data-files-8.0.40-1.el8.x86_64.rpm
wget https://downloads.mysql.com/archives/get/p/23/file/mysql-community-client-plugins-8.0.40-1.el8.x86_64.rpm
wget https://downloads.mysql.com/archives/get/p/23/file/mysql-community-libs-8.0.40-1.el8.x86_64.rpm
rpm -Uhv mysql*
systemctl start mysqld
systemctl enable mysqld