The first thing to do is not think of the medium first (video), but rather - who are you trying to reach? Be really, really specific about who this is and what drives them.

Then, once you know that - how can video content give those people something they care about?

If you answer the first question, the second one is much easier.

Also, check out a business I worked with in this space  looking to do just what you're asking:

https://www.thisisconstruction.com.au/

Agreed @Beau Ushay video marketing is an integral part of growing any business regardless of the industry.

When construction companies are trying to figure out how to include video marketing in their overall marketing approach, these are some routes they can take:

1. Connect and show potential clients what makes your business unique. Tell your story with an About Me or Business Card "video."
2. Client testimonials videos are a great way to show potential customers that your previous customers are quite happy and highly recommend your work. "Social Proof" is integral in building trust and showing prospective customers the value your construction business can provide. The importance of this is double for a construction business where large purchases are often made. 
3. Showcase video, a walkthrough (or drone shot) video, is a captivating way to show your work on your website to prospective customers. 
4. Time-Lapse videos, the construction or renovation process usually involves a massive transformation. These types of videos allow you to show your work off in a way that highlights the impact you (and/or) your team made from the beginning.
5. Tutorial videos maybe the best way to branch out and acquire new clients; this passive approach is guaranteed to help you establish yourself as an industry expert that people turn to for advice.