For collections, the video player has two different layouts, Sidebar and Thumbnail.
Navigate to Customization > Customize and choose Content Page in the drop down at the top. Under the Player block you can choose the chapter style you prefer.
The two options will look like this:
Sidebar
Thumbnails
