The Tower of Babel story from Genesis 11 undoubtedly takes place in or near Babylon.
Babylonians were more than likely Semitic (from Shem's family line) since most ancestors of Arphaxad were also described as Chaldeans. Babylonians came into power and overtook the Assyrians in Mesopotamia. The Egyptians had aligned with the Assyrians to try to relive their glory days of domination. But, the Babylonians eliminated Egypt as a threat as seen in 2 Kings 24:7. The Bible recorded Babylonians led by Nebuchadnezzar conquering the remnant of the Southern Kingdom of Judah & taking them into captivity in Babylon in 2 Kings 25:1-22 and 2 Chronicles 36:17-20. Despite the warnings from Jeremiah against it, some Jews fled to Egypt during this time - Jeremiah 41, 42 and 43.
Their empire was run from the capital city Babylon until the Persians conquered the region.
Modern day countries that reside in the boundaries of the Babylonians include Turkey, Syria & Iraq and may have even reached as far south as Jordan and Israel.
Jeremiah 21:4, 9; 22:25; 24:5; 25:12; 32:4-5, 24-25, 28-29, 43; 35:11; 37:5, 8-11, 13-14; 38:2, 18-19, 23; 39:5, 8; 40:9-10; 41:3, 18; 43:3; 50:1, 8, 25, 35, 45; 51:54; 52:7-8, 14, 17