2. LAI et al.: CONTENT-BASED LCD BACKLIGHT POWER REDUCTION USING HISTOGRAM ANALYSIS 551
Fig. 2. Block diagram for NBDA.
to NBDA to analyze the image histogram. First, RGB is trans-
formed to , and Y (luminance) is regarded as gray-level.
By using a statistical analysis of the image histogram, NBDA
calculates the mean value and median value of the displayed
image. A high mean value indicates that the backlight will be
controlled to select a low current to save the system power based
Fig. 3. New backlight dimming algorithm.
on different backlight current levels. Fig. 2 shows the NBDA
block diagram to control backlight by histogram analysis. The
image histogram represents the distribution of the gray level.
The five steps of the NBDA algorithm are detailed in Fig. 3.
The definitions of the mean and the median of the image his-
togram are as follows:
(5)
(1)
(2) (6)
(3)
(7)
where is the luminance value from the RGB to
color space, and is the probability density function. Ac-
Equation (4) shows that the generated output data,
cording to (1) and (2), the static values of the histogram can
, become times of the original input data,
be estimated. Otherwise, a different backlight current level ac-
(R, G, B), where is the contrast factor gain. Because of the
cording to (3) (Step 4) can be selected. In Step 5, if the abso-
elimination of , (5) and (6) show that the proposed NIEA has
lute difference between the mean value and the median value
no distortion in the hue (H) or saturation (S)color space, so the
is greater than 60 (decimal), it implies there is a large variation
values of the new and are the same as the original H
in the image. Therefore, the NBDA will not change the LCD
and S. However, (7) shows that the enhancing luminance
backlight current because of the image fidelity issue, and the
becomes times of the original luminance (V).
original settings are kept. For this study, the backlight current
After the LCD backlight current level is selected based
is divided into eight different levels, and the NBDA selects the
on NBDA, NIEA compensates for the image contrast so that
proper backlight current level in terms of the mean value of the
viewers notice no conspicuous changes in the image quality.
image histogram.
NIEA defines a luminance enhancement curve, as shown in
B. New Image Enhancement Algorithm (NIEA) Fig. 4, which splits the image pixels into 16 equal intervals.
An input, , can be mapped to an output, , by the
From the viewpoint of the color space, when the gray-level
luminance enhancement curve. Since the luminance enhance-
data of the image are input to the NIEA, the proposed image
ment curve is nonlinear, the piecewise linear method is used to
enhancement approach does not cause distortion in hue (H) or
approach the luminance enhancement curve consisting of 16
saturation (S); only the image luminance (V) is enhanced. The
line segments.
analysis is derived as follows:
The NIEA algorithm is shown in Fig. 5. In Step 1, the gray-
level data are input to NIEA pixel by pixel; then can be
(4) calculated for the corresponding image pixel. In Step 2, the new
are then calculated and output to the LCD panel.
3. 552 JOURNAL OF DISPLAY TECHNOLOGY, VOL. 7, NO. 10, OCTOBER 2011
visual quality, the structural similarity index metric (SSIM) was
derived according to [16]. HVS is highly adapted for extracting
structural information. The formulas are represented as follows:
(9)
(10)
(11)
where , , and are luminance, contrast
and structural similarity, respectively. Fig. 6 shows the block
diagram of the SSIM measurement system. In order to calculate
the value of SSIM, we rearrange (9) to (10) and (11), where
, and stand for mean, standard deviation and correlation
coefficient, respectively. The final value of SSIM is between 0
and 1. When the value is closer to 1, it signifies, from the HVS
perspective, that the extracted structural information of the two
images is almost the same.
Fig. 4. Piecewise-linear method of NIEA. III. IMPLEMENTATION AND PERFORMANCE ANALYSIS
The proposed algorithms are implemented on a field pro-
grammable gate array (FPGA) platform. The block diagram
of the FPGA platform is shown in Fig. 7. An external flash
memory (USB flash disk) and SDRAM module on board to
store the original images data and the modified image data, re-
spectively, are required. Fig. 8 shows our proposed architecture.
The architecture consists of three parts: color transformation
module, NBDA module, and NIEA module. The transforma-
tion module from the RGB to is implemented using
canonical-signed-digit (CSD) fixed-coefficient multiplier. The
NBDA and NIEA modules are implemented using hardware
description language (HDL), Verilog, according to the algo-
rithms of NBDA and NIEA (Figs. 3 and 5). Fig. 9 shows the
photo of the display platform, with a 3-in TFT LCD panel with
a resolution of 960 240 pixels to display the modified image.
The maximum voltage the platform could support is 9.6 V, and
the corresponding current is 25 mA. The circuits on FPGA read
the image data from flash memory and perform the proposed
NBDA and NIEA algorithms.
From the experimental results, the upper parts of Figs. 10–13
Fig. 5. New image enhancement algorithm (NIEA). show the original test images without the proposed algorithms
having been performed. Thus, the backlight controller does
not change the backlight current; the default current setting
Consequently, NIEA can improve the image quality. The for- is around 22 mA as measured by the current meter. Next, the
mula for is defined in (8): middle parts of Figs. 10–13 show the modified test images
using the proposed algorithms, NBDA and NIEA. The back-
light controller lowers the backlight current to reduce power
dissipation. Moreover, the lower parts of Figs. 10–13 show the
(8) histogram analysis used to determine the values of mean, me-
where –16, , dian, standard deviation and correlation coefficient to evaluate
represents the original image pixels (0–255) and the image quality.
represents the enhanced image pixels (0–255). Furthermore, NBDA and NIEA select the suitable backlight
current by using image histogram and enhancing the image con-
C. Image Quality Assessment Using SSIM Index trast to compensate for the image brightness; for example, the
Usually, the mean square error (MSE) and the peak signal-to- values of the mean and medium in Fig. 10 are C (hex) and
noise ratio (PSNR) are adopted to evaluate image quality. How- 5 (hex), respectively. Because the difference between the two
ever, as they are sometimes not well-matched to perceive the values is less than 60 (decimal), NBDA selects the current level
4. LAI et al.: CONTENT-BASED LCD BACKLIGHT POWER REDUCTION USING HISTOGRAM ANALYSIS 553
Fig. 6. Block diagram of the SSIM measurement system.
Fig. 7. Block diagram of the FPGA platform.
Fig. 8. Proposed architecture.
Fig. 10. Test Image 1.
In order to compare backlight power savings based on the
same comparison level, [5] proposed a backlight dimming al-
gorithm using a backlight dimming gray (BDG) level at 75% of
the histogram, which is defined as the characteristic of image
data. This backlight-dimming ratio is calculated as
. For example, the BDR of Fig. 10 is equal to
. The backlight current of [5] mA
mA, the power saving of the backlight
. However, the power saving of
our NBDA is . Hence the pro-
posed algorithm saves more power than [5].
From the experimental results in Table I, the backlight current
Fig. 9. Display platform. selected by NBDA, on average, reduces power consumption by
47%. This is superior to [5]. However, NIEA not only increases
the image contrast but also sustains the image quality.
0 to drive the LCD panel. Then, the (R, G, B) data are input to In Tables II and III, the ratio of image enhancement and
perform NIEA, and NIEA adopts the piecewise linear method PSNR value are 6.8233% and 93.116 dB on average, respec-
to compensate for image brightness and obtain the final current tively. In order to obtain a good match with HVS quality, the
(9.2 mA). SSIM method is used to evaluate the images. As Table IV
5. 554 JOURNAL OF DISPLAY TECHNOLOGY, VOL. 7, NO. 10, OCTOBER 2011
Fig. 13. Test Image 4.
Fig. 11. Test Image 2.
TABLE I
COMPARISON OF BACKLIGHT POWER SAVING RATIO
TABLE II
RATIO OF IMAGE ENHANCEMENT
Fig. 12. Test Image 3.
shows, the values are close to 1; thus, our proposed algorithms
can sustain the original image quality.
NBDA adopts the content-based histogram analysis to select the
IV. CONCLUSION corresponding TFT LCD backlight current and decreases power
In this paper, we have proposed two algorithms to realize consumption. Moreover, the NIEA increases the image contrast
lower power consumption and image contrast enhancement: the level which compensates for the brightness of the image when
NBDA, and the new image enhancement algorithm (NIEA). The the user can identify no conspicuous changes in the image by the
6. LAI et al.: CONTENT-BASED LCD BACKLIGHT POWER REDUCTION USING HISTOGRAM ANALYSIS 555
TABLE III [11] E. Y. Oh, S. H. Baik, M. H. Sohn, K. D. Kim, H. J. Hong, J. Y. Bang,
PSNR TO EVALUATE IMAGE QUALITY K. J. Kwon, M. H. Kim, H. Jang, J. K. Yoon, and I. J. Chung, “IPSmode
dynamic LCD-TV realization with low black luminance and high con-
trast by adaptive dynamic image control technology,” J. Soc. Inf. Dis-
play, vol. 13, pp. 215–219, 2005.
[12] C.-C. Sun, S.-J. Ruan, M.-C. Shie, and T.-W. Pa, “Dynamic contrast en-
hancement based on histogram specification,” IEEE Trans. Consumer
Electron., vol. 51, no. 4, pp. 1300–1305, Nov. 2005.
[13] H. Cho and O. Kwon, “A backlight dimming algorithm for low power
and high image quality LCD applications,” IEEE Trans. Consumer
Electron., vol. 55, no. 4, pp. 839–844, May 2009.
[14] A. Bartolini, M. Ruggiero, and L. Benini, “Visual quality analysis for
dynamic backlight scaling in LCD systems,” in Proc. IEEE Des. Autom.
& Test in Eur. Conf. & Exhib., 2009, pp. 1428–1433.
[15] M. Ruggiero, A. Bartolini, and L. Benini, “DBS4video: Dynamic lu-
TABLE IV
minance backlight scaling based on multi-histogram frame character-
SSIM TO EVALUATE IMAGE QUALITY
ization for video streaming application,” in Proc. 8th ACM EMSOFT,
Atlanta, GA, 2008, pp. 109–118.
[16] Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image
quality assessment: From error visibility to structural similarity,” IEEE
Trans. Image Process., vol. 13, no. 4, pp. 600–612, Apr. 2004.
[17] S. Lee, K. Um, and B. Choi, “A power reduction method for LCD
backlight based on human visual characteristics,” in Proc. Int. Conf.
on Consumer Electron., 2008, pp. 1–2.
Yeong-Kang Lai (M’94) was born in Taipei, Taiwan,
in 1966. He received the B.S. degree in electrical
engineering from the Tamkang University, Taipei,
Taiwan, in 1988, and the M.S. and Ph.D. degree
HVS quality. The experimental results show that the proposed from the National Taiwan University, in 1990 and
NBDA algorithm, on average, reduces power consumption by 1997, respectively.
From 1992 to 1993, he was with the Institute
47%, while the proposed NIEA algorithm enhances the image of Information Science, Academia Sinica, Taiwan,
contrast ratio and sustains image quality. Finally, SSIM is used where he worked on video conference system. In
to measure image quality, which proves to be very close to that 1997, he joined the Electrical Engineering Depart-
ment, Chang Gung University, Taoyuan, Taiwan,
of the original image. as an Assistant Processor. From 1998 to 2001, he was Assistant Processor of
the Information Engineering Department at National Dong Hwa University,
Hualien, Taiwan. Currently, he is Associate Processor of the Department of
REFERENCES Electrical Engineering, National Chung Hsing University, Taichung, Taiwan.
[1] G. Z. Wang, F. C. Lin, and Y. P. Huang, “Delta-color adjustment for He is also a member of the honor society Phi Tau Phi. His research interests
spatial modulated color backlight algorithm on high dynamic range include video compression, DSP architecture design, video signal processor
LCD TVs,” J. Display Technol., vol. 6, no. 6, pp. 215–220, Jun. 2010. design, and VLSI signal processing.
[2] C. H. Chen and H. P. D. Shieh, “Effects of backlight profiles on
perceived image quality for high dynamic range LCDs,” J. Display
Technol., vol. 4, no. 2, pp. 153–159, Jun. 2008.
[3] W. S. Oh, D. Cho, K. M. Cho, G. W. Moon, B. Yang, and T. Jang, “A Yu-Fan Lai (S’06) was born in Taichung, Taiwan, on
novel two-dimensional adaptive dimming technique of X-Y channel June 14, 1978. He received the B.S. degree in auto-
drivers for LED backlight system in LCD TVs,” J. Display Technol., matic control engineering from the Feng Chia Uni-
vol. 5, no. 1, pp. 20–26, Jan. 2009. versity, Taichung, Taiwan, in 2000, and the M.S. de-
[4] F. C. Lin, Y. P. Huang, L. Y. Liao, C. Y. Liao, H.-P. D. Shieh, T. M. gree in electrical engineering from the Chung Hwa
Wang, and S. C. Yeh, “Dynamic backlight gamma on high dynamic University, Hsinchu, Taiwan, in 2003. From 2003 to
range LCD TVs,” J. Display Technol., vol. 4, no. 2, pp. 139–146, Jun. 2007, he ever worked in Ritek Corporation, Hsinchu,
2008. Taiwan. He is currently pursuing the Ph.D. degree in
[5] C.-C. Lai and C.-C. Tsai, “Backlight power reduction and image con- the department of electrical engineering at National
trast enhancement using adaptive dimming for global backlight appli- Chung Hsing University.
cations,” IEEE Trans. Consumer Electron., vol. 54, no. 2, pp. 669–674, His major research interests include image and
May 2008. video processing, VLSI architecture design of image and video coding, and
[6] T. Shirai, S. Shimizukawa, T. Shiga, and S. Mikoshiba, “RGB-LED VLSI design for digital signal processing.
backlights for LCD-TVs with 0D, 1D, and 2D adaptive dimming,” in
SID2006 Digest of Technical Papers, 2006, pp. 1520–1523.
[7] H. Chen, J. Sung, T. Ha, and Y. Park, “Locally pixel-compensated
backlight dimming for improving static contrast on LED backlight
LCDs,” in SID2007 Dig. Tech. Papers, 2007, pp. 1339–1342. Peng-Yu Chen received the M.S. degree in electrical
[8] D. Yeo, Y. Kwon, E. Kang, S. Park, B. Yang, G. Kim, and T. Jang, engineering from the National Chung Hsing Univer-
“Smart algorithms for local dimming LED backlight,” in SID Int. Symp. sity, Taichung, Taiwan.
Dig. Tech. Papers, 2008, pp. 986–989. His major research interests include image and
[9] S. Lee, K. Um, and B. Choi, “A power reduction method for LCD video processing, FPGA architecture design of
backlight based on human visual characteristics,” in Proc. Int. Conf. image and video coding, and FPGA design for
on Consumer Electron., 2008, pp. 197–198. digital signal processing.
[10] N. Raman and G. J. Hekstra, “Content based contrast enhancement for
liquid crystal displays with backlight modulation,” IEEE Trans. Con-
sumer Electron., vol. 51, no. 1, pp. 18–21, Feb. 2005.