When I open a Simulink model with System Generator blocks, or access the System Generator blockset, a license is checked out and not checked in again until I close MATLAB.
This is the expected behavior for System Generator 11.3.
Starting in ISE software 11.4, System Generator will only checkout a license during Netlist Generation and will check the license back in upon completion.