A filter effect imparting device includes a characteristic-variable filter that has a variable filter characteristic corresponding to a coefficient group composed of a plurality of filter coefficients, and a control circuit that changes the coefficient group from a first coefficient group that is set as a start point to a second coefficient group that is set as an end point. The control circuit retains the coefficient group during the change and, in newly setting a third coefficient group as the end point, the control circuit sets the retained coefficient group as the start point.