Our brains are extremely powerful things, so powerful in-fact that they create images that aren't even there, from small bits of information. 

The above image is a black and white photo. Now, if you look at it close enough, you'll be able to see colored lines throughout the image, some red, some blue and some yellow, all working together to help your eyes paint a picture that isn't really there. Now if you look at the same picture from further back, the lines disappear and the image looks, well colored.

Now, depending on your brain, because yes they are all different, you may see the image or colors in your own unique way. Let's take a look at another image shall we. 

This image is black and white, obviously, now the same image can look different by using different, shapes, and colors can affect how we perceive the image. 

Pretty trippy right, it's easy to forget that your looking at a black and white photograph, and sure you could say there is color in the form of dots and lines, but not enough to make the entire image look colored, that's your brain doing the extra lifting. 

The same effect can be used in videos as well. Take a look.