In a small saucepan, heat the milk or cream, brown sugar, and vanilla extract over medium heat, stirring constantly until the sugar is dissolved and the mixture is hot.
Pour the hot milk mixture over the coffee in the mug and stir to combine.
Top the drink with whipped cream and sprinkle with cocoa powder or cinnamon, if desired.