Why were archaea and bacteria grouped together by biologists until recently?

Probably because they look like the same thing at first glance. They're the same size, they reproduce by binary fission, and use flagella to move. Their chemistry is different, as the species of Archaea have completely different cell walls and lipid bonding than Bacteria. Enough so that they were considered different kingdoms of organisms ever since the discovery was made.