Resolve fatal memory error when upgrading WP

From time to time when I try to upgrade an installation of WordPress I get an error that starts “Fatal Error: Allowed memory size of 33554432 bytes exhausted…” This means that WordPress needs a certain amount of space allocated to perform the...