This phase I trial studies the side effects of stereotactic radiosurgery with abemaciclib, ribociclib, or palbociclib in treating patients with hormone receptor positive breast cancer that has spread to the brain (brain metasteses). Stereotactic radiosurgery is a specialized radiation therapy that delivers a single, high dose of radiation directly to the tumor and may cause less damage to normal tissue. Abemaciclib, ribociclib, and palbociclib may stop the growth of tumor cells by blocking some of the enzymes needed for cell growth. Giving abemaciclib, ribociclib, or palbociclib concurrently with stereotactic radiosurgery may reduce the side effects and/or increase the response to each of the therapies.