Hello Vinodh,
After doing the implementation of BADI_LAYER, did you assign the implementation to sort in BADI_MATERIAL_CHECK.
Goto SE18 --> Display the badi --> Utilities --> sort --> In the pop up select special sort and give the implementation name of your BADI_LAYER.
Regards,
Tp