For the case that fails see which CA is being used (check the issuer field). The CA certificate will already be installed on your device as a trusted root CA.
Then get CRL field out of the CA certificate from your machine, and then try and request that URL directly to see what happens.
It sounds like the retrieval process is experiencing errors.