The plugin is very lightweight. The "press Ctrl+Enter..." caption (or your text) can be configured to be automatically appended to selected post types or be inserted anywhere using a shortcode. Disabled features don't get loaded, so performance impact is minimized to the lowest notch.
Besides text, caption also can be set as image defined by URL.