Preheat oven to 350°F. Prepare an 8x8 baking pan with nonstick cooking spray and parchment paper.
In a large mixing bowl with an electric mixer (or stand mixer fitted with a paddle attachment), cream unsalted butter and granulated sugar for a few minutes until light and creamy.
Add in egg, vanilla extract and almond extract. Mix to combine.
Add in salt, baking powder, and all-purpose flour. Mix until combined. Then, add milk and mix on low speed until a soft cookie dough forms. Do not over mix the dough.
Press the sugar cookie dough into the prepared baking pan to create an even layer of cookie dough.
Bake the sugar cookie bars for approximately 25 minutes until they are light golden-brown around the edges.
Remove the baking pan from the oven. Allow the sugar cookie bars to cool to room temperature in the pan while making the vanilla cream cheese frosting.