Bulk Rotational Symmetry Breaking in Kondo Insulator SmB6

Abstract: Kondo insulator samarium hexaboride (SmB6) has been intensely studied in recent years as a potential candidate of a strongly correlated topological insulator. One of the most exciting phenomena observed in SmB6 is the clear quantum oscillations appearing in magnetic torque at a low temperature despite the insulating behavior in resistance. These quantum oscillations show multiple frequencies and varied effective masses. The origin of quantum oscillation is, however, still under debate with evidence of both two-dimensional Fermi surfaces and three-dimensional Fermi surfaces. Here, we carry out angle-resolved torque magnetometry measurements in a magnetic field up to 45 T and a temperature range down to 40 mK. With the magnetic field rotated in the (010) plane, the quantum oscillation frequency of the strongest oscillation branch shows a four-fold rotational symmetry. However, in the angular dependence of the amplitude of the same branch, this four-fold symmetry is broken and, instead, a twofold symmetry shows up, which is consistent with the prediction of a two-dimensional Lifshitz-Kosevich model. No deviation of Lifshitz-Kosevich behavior is observed down to 40 mK. Our results suggest the existence of multiple light-mass surface states in SmB6, with their mobility significantly depending on the surface disorder level.