Got it working.
In my Direct Assignment and Direct Unassignment of ONLY Priv, I have to also Direct Assign and Direct Unassign the SYSTEM priv. (and ensure I give the passes time to complete their tasks via uSleep)
Thanks to Anu Biju (a True IdM Guru) for the tip.