Yes, but probably not in large enough numbers to make an impact. The PLAAF currently has close to (if not surpassing) 1000 combat aircrafts that are able to use PL15, likely the stockpile is at least a few times that. Exporting a few dozen here and a hundred something there over the next decade or so wouldn't really affect the situation meaningfully imo.
That said, I'm not entirely sure that J16s would be retired when PL-15 are used up, PLAAF is a large organization and it's entirely possible that the J-16 being a rugged multirole platform will survive the next decade or two, even more if situation allows / requires it.