Purpose

This study incorporates alisertib, the small-molecule inhibitor of Aurora A activity, in the treatment of patients younger than 22 years of age. Patients with recurrent or refractory AT/RT or MRT will receive alisertib as a single agent. Patients with newly diagnosed AT/RT will receive alisertib as part of age- and risk-adapted chemotherapy. Radiation therapy will be given to children ≥12 months of age. Patients with AT/RT and concurrent extra-CNS MRT are eligible. Alisertib will be administered as a single agent on days 1-7 of each 21-day cycle in all recurrent patients enrolled on Stratum A. For the patients on the newly diagnosed strata (B, C or D), alisertib will be administered in sequence with chemotherapy and radiotherapy. This study has 3 primary strata: (A) children with recurrent/progressive AT/RT or extra-CNS MRT, (B) children < 36 months-old with newly diagnosed AT/RT, (C) children > 36 months old with newly diagnosed AT/RT. Children with concurrent MRT will be treated according to age and risk stratification schemes outlined for strata B and C and will have additional treatment for local control. Children with synchronous AT/RT will be treated with age and CNS risk-appropriate therapy, and also receive surgery and/or radiation therapy for local control of the non-CNS tumor. PRIMARY OBJECTIVES - To estimate the sustained objective response rate and disease stabilization in pediatric patients with recurrent or progressive AT/RT (atypical teratoid rhabdoid tumor in the CNS) (Stratum A1) treated with alisertib and to determine if the response is sufficient to merit continued investigation of alisertib in this population. - To estimate the sustained objective response rate and disease stabilization in pediatric patients with recurrent or progressive extra-CNS MRT (malignant rhabdoid tumor outside the CNS) (Stratum A2) treated with alisertib and to determine if the response is sufficient to merit continued investigation of alisertib in this population. - To estimate the 3-year PFS rate of patients with newly diagnosed AT/RT who are younger than 36 months of age at diagnosis with no metastatic disease (Stratum B1) treated with alisertib in sequence with induction and consolidation chemotherapy and radiation therapy (depending on age) and to determine if the rates are sufficient to merit continued investigation of alisertib in this population. - To estimate the 1-year PFS rate of patients with newly diagnosed AT/RT who are younger than 36 months of age at diagnosis, with metastatic disease (Stratum B2) treated with alisertib in sequence with induction and consolidation chemotherapy and to determine if the rates are sufficient to merit continued investigation of alisertib in this population. - To estimate the 3-year PFS rate of patients with newly diagnosed AT/RT who are 3 years of age or greater at diagnosis with no metastatic disease and gross total resection or near total resection (Stratum C1) treated with alisertib in sequence with radiation therapy and consolidation chemotherapy and to determine if the rates are sufficient to merit continued investigation of alisertib in this population. - To estimate the 1-year PFS rate of patients with newly diagnosed AT/RT who are 3 years of age or greater at diagnosis with metastatic or residual disease (Stratum C2) treated with alisertib in sequence with radiation therapy and consolidation chemotherapy and to determine if the rates are sufficient to merit continued investigation of alisertib in this population. - To characterize the pharmacokinetics and pharmacodynamics of alisertib in pediatric patients and to relate drug disposition to toxicity. SECONDARY OBJECTIVES - To estimate the duration of objective response and PFS in patients with recurrent/progressive AT/RT and MRT (Strata A1 and A2). - To estimate PFS and OS distributions in patients with newly diagnosed AT/RT (Strata B1, B2, B3, C1 and C2). - To describe toxicities experienced by patients treated on this trial, specifically any toxicities of alisertib when administered as a single agent or in combination with other therapy over multiple courses and toxicities related to proton or photon radiation therapy. - To describe the patterns of local and distant failure in newly diagnosed patients (Strata B1, B2, B3, C1 and C2). Local control relative to primary-site radiation therapy, with criteria for infield, marginal, or distant failure will also be reported descriptively.