Can i loop out WP gallery images with custom html around each?

CMS & WordPress
1

Is it possible to loop out images in a gallery like this:

<ul>
<li><img /></li>
<li><img /></li>
<li><img /></li>
</ul>