Thread:Extension talk:MultimediaViewer/Performance/reply

is about page caching. You probably want  although this depends on what exactly is slow (maybe you could profile it?). FWIW image transformations are cached by storing the thumbnails, so that should not be affected by lack of memcached/APC.

(Personally, I would just switch hosts. Running a site without an opcode cache is a bit masochistic.)