To reduce loss of life and property from fire, an early warning is an imperative. A fire detectionsystem based on light detection and analysis is proposed in the paper. This system uses HSV and YCbCr color models with given conditions to separate orange, yellow, and high brightness light from background and ambient light. Fire growth is analysed and calculated based on frame differences. The overall accuracy from the experiments has been greater than 90%.