Only if it's better. Which it may or may not be, depending on your gear level and personal preferences. See the FAQ for details.
According to the EP values for Mutilate, it appears that a 32 AP gem is mildly superior to a 16 AGI gem. However, with the Seal Fate and Focused Attacks talents in mind, wouldn't it better to use the 16 AGI gem?