It looks like it is the black part that is degrading. I opened it up and it looks like most of the black foam is gone!
As an experiment, I tried heating both foams with a heat gun. Then I rubbed the foam with my finger - the black foam started crumbling away. I'm thinking the adhesive stops holding and then the two foams have friction between them. The black foam can't take the heat and starts dusting away.