Preheat the oven to 350°F (175°C). Grease a baking dish.
Peel and slice the peaches.
In a medium bowl, mix together the brown sugar, saffron threads, cinnamon, and nutmeg. Add the sliced peaches and toss to coat. Transfer the mixture to the greased baking dish.
In a separate bowl, combine the flour, oats, and butter. Use your fingers or a pastry cutter to mix the ingredients together until crumbly. Stir in the chopped almonds.
Sprinkle the crumble mixture evenly over the peaches.
Bake in the preheated oven for 35-40 minutes, until the topping is golden brown and the peaches are bubbling.
Remove from the oven and let it cool slightly before serving.
Serve warm with a scoop of vanilla ice cream, if desired.