Usually installing the guest additions will allow to allocate more RAM for graphics.
But there could be another angle as well.
Sometimes if you are not on fullscreen mode on Virtualbox, and if you set a higher resolution then the guest OS screen becomes so big that it does not fit in the display...