Inclusion Criteria:

1. Patients must have advanced solid tumor: they have either a disease where there is no established standard of care therapy or have failed one or more prior therapy. (for all treatment arms)
2. Patients must have ECOG performance status < or = 2 (0-2). (for all treatment arms)
3. Patients must have normal organ and marrow function as defined below: Platelets > 50,000/uL Total bilirubin < 2.0 mg/dL and ALT <3 x the institutional upper limit of normal Creatinine < 2.0 mg/dL or creatinine clearance > 40mL/min. (for all treatment arms)
4. Patients must be able to understand and the willingness to sign an IRB-approved written informed consent document. (for all treatment arms)
5. Women of child-bearing potential and men must agree to use adequate contraception prior to study entry, for the duration of study participation, and for 30 days after the last dose. (for all treatment arms)

Exclusion Criteria:

1. Uncontrolled intercurrent illness including, but not limited to, ongoing or active infection, symptomatic congestive heart failure (NYHA Class III or IV), unstable angina pectoris, symptomatic cardiac arrhythmia, active bleeding, active thrombosis, or psychiatric illness/social situations that would limit compliance with study requirements. (for all treatment arms)
2. History of allergic reactions to the study drugs or their analogs. (for all treatment arms)
3. Failure to recover from any prior surgery within 4 weeks of study entry. (for all treatment arms)
4. Any treatment specific for tumor control within 3 weeks of study drugs; or within 2 weeks if cytotoxic agents were given weekly (within 6 weeks for nitrosoureas or mitomycin C), or within 4 half-lives for target agents with half lives and pharmacodynamic effects lasting less than 5 days (that include but are not limited to erlotinib, sorafenib, sunitinib, bortezomib, and other similar agents); or failure to recover from the toxic effect of any therapy prior to study entry. (for all treatment arms)
5. Patients who received the same combination of the study agents for cancer control and who are currently on valproic acid treatment for seizure control. (for all treatment arms)
6. Study agents cannot be obtained for any reason since this study does not provide free agents. (for all treatment arms)
7. Inadequately controlled hypertension (defined as systolic blood pressure 140 and/or diastolic blood pressure > 90 mmHg on antihypertensive medications) and any prior history of hypertensive crisis or hypertensive encephalopathy. (for the treatment arms of valproic acid plus sorafenib, and valproic acid plus sunitinib)
8. New York Heart Association (NYHA) Grade II or greater congestive heart failure and history of myocardial infarction or unstable angina within 6 months prior to study enrollment. (for the treatment arms of valproic acid plus sorafenib, and valproic acid plus sunitinib)
9. History of stroke or transient ischemic attack within 6 months prior to study enrollment and, for the sunitinib arm only, known history of brain or leptomeningeal metastases. (for the treatment arms of valproic acid plus sorafenib, and valproic acid plus sunitinib)
10. Significant vascular disease (e.g., aortic aneurysm, aortic dissection) and symptomatic peripheral vascular disease. (for the treatment arms of valproic acid plus sorafenib, and valproic acid plus sunitinib)
11. Evidence of bleeding diathesis or coagulopathy. (for the treatment arms of valproic acid plus sorafenib, and valproic acid plus sunitinib)
12. Major surgical procedure, open biopsy, or significant traumatic injury within 28 days prior to study enrollment or anticipation of need for major surgical procedure during the course of the study. (for the treatment arms of valproic acid plus sorafenib, and valproic acid plus sunitinib)
13. Minor surgical procedure, excluding placement of a vascular access device, within 7 days prior to study enrollment. (for the treatment arms of valproic acid plus sorafenib, and valproic acid plus sunitinib)
14. History of abdominal fistula, gastrointestinal perforation, or intra-abdominal abscess within 6 months prior to study enrollment; and serious, non-healing wound, ulcer, or bone fracture. (for the treatment arms of valproic acid plus sorafenib, and valproic acid plus sunitinib)
15. Urine dipstick for proteinuria > 2+ (patients discovered to have > 2+ proteinuria on dipstick urinalysis at baseline should undergo a 24 hour urine collection and must demonstrate < 1g of protein in 24 hours to be eligible). (for the treatment arms of valproic acid plus sorafenib, and valproic acid plus sunitinib)
16. Concomitant use of potent inhibitors or inducers of the hepatic cytochrome P450 enzyme 3A4. (for the treatment arms of valproic acid plus sunitinib, valproic acid plus dasatinib, valproic acid plus erlotinib and valproic acid plus lapatinib)