Use gray -- the color of an inactive symbol.
Make the symbol as large as the others.
Place the icon on the baseline of the time display.
Exchange correspondent filter icons
Color 'wrong'-icon-filter red if active