On the File | File Editor tab, in the View group: Select Detach Colour Set to remove the colour set attached to the colour-coded column (field values) you have selected.
This option is also available on the Lookup Table Editor tab for Lookup Tables.