Fortunately, there are plenty of safe ways to add flavor to food that even children can appreciate. Simply because they are children does not mean that they do not enjoy a bit of spice. Even delicate taste buds can handle a bit of garlic and a few olives. Chop the pieces very small, and avoid using large chunks.
Of course, there are also a few foods to avoid. Stay away from blue cheese and anything that has a strong odor. Horseradish is another major no-no unless it is mixed with something tame. Remember: stinky foods are much more likely to repel children than to attract them.
Always check with your doctor regarding safety of your infant or child.