We got up on the roof and pulled the tiles off the fascia panel. Ah, this is going to be harder than I thought, as this is under that is under that and so on until we'll have to undo half of the roof. I hammered all the rotten stuff out, and cut away the good wood to make a squarish hole, and we'll patch it, seeing as it's not structural.
I found the paint for the fascia, but it's old so it's gone hard. Of course. Still, we have a paint code, so we should be able to get more.