If the generation of the graphic presentation requires a lot of CPU time or memory, then yes, you could cache your graphic presentation (HTML I guess, right?). Perhaps in the database/memory, as a transient.
Caching post meta data (that you use to generate the graphic) is not necessary, because WP already handles this. If you do it too, then the same data will get stored twice in memory. But keep in mind that by default WP's cache is not persistent, so the cache gets flushed after script finishes execution (on each page load). There are plugins out there that implement persistent object caching, if you need it.
Regardless of all the above, if you can use a persistent object caching plugin (example), do it! Because accessing the memory will always be faster than querying a database, which is typically a file on a disk, and disks are slow.