Modern MAME is a beast of scientific accuracy. MAME 2003 is a tool for playing games. It is stable, rarely crashes, and has been ported to virtually every operating system capable of running code.
This is the biggest drawback. MAME 2003 does not know about any arcade game discovered or fixed after 2003. mame 2003 reference set