Make sure the bundle identifier you entered when uploading to Meraki matches what is in the .app
Not sure how this would work with Java since there's no .app, but the bundle identifier on the installer is Oracle.MacJREInstaller
Update: This only works on machines that don't have Systems Manager agent installed...