I have some pretty thick sites and haven’t noticed anything crazy. I know registering blocks with PHP using ACF can have some slow down after a certain amount of registered fields/blocks – but it is not within my control and entirely on ACF’s side and JSON exports have the same issue/bottleneck.
I’m not sure what the comparison is slow-down wise when storing fields in the database.