1. Coarsely chop and mix together the rosemary, thyme, garlic and anchovy, if using. Sprinkle in the salt and mash into a slightly chunky paste using the flat part of the knife. Place in a small pot with the olive oil and warm over low heat until fragrant and sizzling, about 15 minutes. Set aside to cool.
2. Warm the vinegar, sugar, pepper flakes and zests in another small pot over low heat, stirring, until the sugar is dissolved and the vinegar is steaming, 15 minutes. Set aside to cool.
3. Transfer the oil and vinegar into separate small serving dishes and serve with assorted vegetables for dipping.