Can you play online with a gold membership on xbox live with an arcade?

Kyle asked: i want to bu and xbox 360 but to save $ i want to know if i can just play online with an arcade. if not can i buy a memory card instead of a hdd?