In a large mixing bowl, whisk together the all-purpose flour, granulated sugar, baking powder, pumpkin pie spice and salt. Add in the pumpkin puree, milk, vegetable oil, egg, and vanilla extract. Whisk until the ingredients are well combined and the cupcake batter is smooth.