As soon as you close the control panel, the update alert feature switches back on. You can successfully turn off the updates by launching the Java control panel as an administrator.

Updates also should be available via the Java Control Panel or from Java.com. Update, 5:33 p.m. ET: Included information about Java patches.