In a large mixing bowl, beat the melted butter, peanut butter, granulated sugar, and brown sugar until smooth and creamy. Add the egg and vanilla extract and mix until well combined.
In a separate bowl, whisk together the flour, cornstarch, baking soda, baking powder, and salt. Gradually add the dry ingredients to the peanut butter mixture, mixing just until a thick cookie dough forms. Cover and refrigerate for 1 hour.
Preheat the oven to 325°F (165°C) and line baking sheets with parchment paper. Scoop small portions of dough, roll them into balls, and arrange them in pairs on the baking sheets, leaving space between each pair. Press the paired dough balls with a fork in both directions to create a crisscross pattern and flatten them into connected peanut-shaped cookies.
Bake for 13–15 minutes, or until the edges and bottoms are lightly golden. Let the cookies cool on the baking sheets for a few minutes, then transfer them to a wire rack to cool completely.
In a mixing bowl, beat the peanut butter, powdered sugar, 4 tablespoons of milk, and vanilla extract until smooth and creamy. Add another tablespoon of milk if needed for a softer filling. Pipe or spread the filling onto the flat side of one cookie and sandwich it with another cookie. Repeat with the remaining cookies.