Stainless steel is resistant to embrittlement from cryogenic fuel. This is why they use stainless to make LNG fuel tanks for example. Regular carbon steel would crack and fracture with exposure to cryogenics. This is why for example the original Atlas rocket also used stainless propellant tanks.
SpaceX could not get composites to work. Heck, they could not even get the composite fuel tanks to work in a standard water pressure burst test. Let alone with cryogenic propellant. They could not get the composites to be default free to a point to work after years and much money wasted in testing. That is why they went back to metals. Just think about it, you are talking about carbon fibers glued together, then baked. Good luck making something like that defect free at that kind of size.
I am fairly sure they could use aluminium lithium, like they use in Falcon 9, on the first stage of the Starship, but for whatever reason they did not do this.