It turned out the reason I couldn't login, and I wasn't getting anything on Duo mobile app was because the AD user account I created didn't have the necessary permissions. I have the Duo MFA working now. But I'm kind of confused.
Because, I didn't ask Meraki to adjust the time out, but I was still able to get the Duo push notification and login. So may be the timeout adjustment is not necessary?