Place the baby potatoes in a large pot and cover with cold, salted water. Bring to a boil over medium-high heat and cook for 12 to 15 minutes, until fork-tender.
Drain the potatoes and rinse them briefly under cold water to stop the cooking process. Let them cool completely.
In a large mixing bowl, whisk together the mayonnaise, sour cream, Dijon mustard, fresh herbs, paprika, salt, and black pepper until smooth and well combined.
If the cooled potatoes are large, cut them into bite-sized pieces. Add the potatoes, chopped celery, and beef bits to the bowl with the dressing.
Gently toss the ingredients until the potatoes are evenly coated in the creamy dressing.
Cover the bowl tightly and refrigerate for at least 1 hour to allow the flavors to meld before serving.