The ticket can be assigned to the Agent without the Group being assigned as well. However, if in your Account's Admin has made it mandatory for a ticket to be added to a group, then I am afraid that this will not be possible.