Filter -> Custom Filter only allows me to filter by 2 IDs total.
Excel's Advanced Filter can filter for as many values as you want
Set up your criteria range. The header must be named exactly like the column where Excel should apply your filter to (data table in example)
Select your whole table (A1:A11 in example)
Go to: Menu Bar » Data » Filter » Advanced
Select your whole criteria range including the header under Criteria range (C1:C4 in example)
