Customise (or remove) the margin WordPress automatically applies to captions.
Install like any other plugin, by default will remove the extra margin completely when activated.
e.g.
- Upload
plugin-name.php to the /wp-content/plugins/ directory
- Activate the plugin through the 'Plugins' menu in WordPress
- Enjoy.