In a large bowl, beat together butter, cream cheese and powdered sugar until smooth and no lumps. In another bowl, mix the vanilla pudding mix and milk. Beat until smooth and then add in the whipped cream or the Cool whip. Beat briefly until the mixture is thick. Do not overmix
Fold the cream cheese mixture into the whipped cream mixture as to not deflate the whipped cream. Set this aside and in the bowl of a food processor,(or in a large zip loc with a rolling pin), crush the Oreos into a course sand-like consistency.
In a lightly greased with cooking spray 9X13 inch pan or individual cups or flowerpots, start to layer the crushed Oreos with the pudding mixture. You can layer as many layers as you wish, but make sure you start and finish with the crushed Oreos. Cover and refrigerate overnight. Then decorate with the gummy worms before you serve the dirt cake. ENJOY!