In a large mixing bowl with an electric hand mixer or a bowl of a stand mixer fitted with a paddle attachment, cream together butter and powdered sugar until smooth.
Add in vanilla extract, almond extract, and salt. Mix until combined.
Add in all-purpose flour. Mix on low speed. The dough will be very crumbly but continue to mix until it comes together.
Form the dough into a disc and wrap in plastic wrap. Chill for approximately 30 minutes.
Preheat oven to 350 degrees F and line a baking sheet pan with silicone baking mat or parchment paper.
Use a rolling pin to roll the dough to about 1/4 inch thick on a floured surface. Cut out cookies with cookie cutter.
Place cookies on prepared baking sheet pan. Bake for 10 minutes.
Allow the cookies to cool on the pan for 2 minutes before transferring to a wire rack to cool completely.
Decorate the cookies with royal icing and sprinkles if desired.