Preheat your oven to 400°F (200°C). Grease a 9x13 inch baking dish or a deep oven-safe skillet lightly with oil.
In the baking dish, whisk together the beef broth, coconut milk, peanut butter, soy sauce, rice vinegar, chili oil, minced garlic, and grated ginger until smooth and well combined.
Add the frozen beef dumplings and broccoli florets to the dish. Gently toss them in the sauce to ensure they are well coated, then arrange them in a single even layer. Ensure the dumplings are mostly submerged in the liquid.
Cover the dish tightly with aluminum foil to trap steam. Bake for 20 minutes.
Remove the foil and bake for another 10-15 minutes, or until the sauce has thickened and the dumplings are tender and cooked through.
Remove from the oven. Drizzle with extra chili oil if desired, and garnish with sliced green onions, cilantro, and toasted sesame seeds before serving.