Can I set different order bumps for different products in the cart?

Yes, you can set different order bump offers for different products. You can simply do that by selecting a specific target and relevant bump offer product while creating your offers.