Can't use WP-CLI due to php memory limit

Apparently the PHP CLI memory limit has to be set differently/explicitly, see this discussion