Ultramayhem Org was baptized in summer 2004 but the seed of UltraMayhem was implanted way before. First signs of an organized UltraMayhem were seen back in 1998 when a bunch of Metalheads joined forces to 'mayhemize' the Metal scene under the name RGB. In 2004 they reformed as UltraMayhem Organization, a metal band which desired to refine the core of metal and build a new standard for modern Metal by doing things the way others dare not to.
UltraMayhem Org (now with a shortened name) released their first promo EP, Excuses to Start a War, in autumn 2004; it received exciting reviews in Finnish metal media. After that, there was some changes in the organizational structure including their name by dropping the 'Org' component and some members.
UltraMayhem Org would then release a single in 2006 titled UltraMayhem - Symposium on March 31st, and it's sequel UltraMayhem - Symposium II on May 31st that same year under the membership of KillHill (bass), Vlad Tepez (vocals), Johnny Stoner (guitars), Ron Autero (keyboards/vocals) and Miquel De La Muerte (drums) under the influences of Faith No More, System of a Down, Pantera, Dimmu Borgir and Slayer.
Toby Stoner (Bass) and Tad Turmoil (Drums) took over for the Jeremiad full-length release in 2007.