Großheringen is located in the district of Weimarer Land in north-eastern Thuringia on the border with Saxony-Anhalt, around 15 km north-east of the district town of Apolda. The Ilm and Saale rivers flow through the municipality, with the mouth of the Ilm flowing into the Saale just below the village of Großheringen.

In addition to the eponymous village, the municipality also includes Unterneusulza, located to the north of the Ilm and Thuringian Railway, and Kaatschen-Weichau, known for its wine-growing, situated on the Saale about 2 km above the mouth of the Ilm.

Neighboring municipalities are Bad Sulza, Schmiedehausen and Dornburg-Camburg in Thuringia as well as Naumburg (Saale) and Lanitz-Hassel-Tal in Saxony-Anhalt.