It is possible to remove GPO settings from a pc
You can remove the GPOs from a computer which was previously in an active directory domain by deleting
the S-x-x-xx-xxxxxxxx-…-keys in HKLM\Software\microsoft\windows\currentversion\group policy\ and within containing subfolders.