Experimentation in Product Evaluation: The Case of Solar Lanterns in Uganda, Africa, 2015. MIT; USAID.
Evaluating solar lanterns in Uganda
In summer 2013, a team of MIT faculty and students set off for western Uganda to conduct CITE’s evaluation of solar lanterns. Researchers conducted hundreds of surveys with consumers, suppliers, manufacturers, and nonprofits to evaluate 11 locally available solar lantern models.
To assess each product’s suitability, researchers computed a ratings score from 0 to 100 based on how the product’s attributes and features fared. “Attributes” included characteristics inherent to solar lanterns, such as brightness, run time, and time to charge.
“Features” included less-central characteristics, such as a lantern’s ability to charge a cellphone.
The importance of cellphone charging was a surprising and noteworthy finding, Sanyal says.
“One of the things that stuck with me was that [consumers] were most concerned with whether or not the solar lantern charged their cellphone. It was a feature we never expected would be so important,” Sanyal says. “For some, having connections may be more valuable than having light.”
CITE worked with USAID to select solar lanterns as the product family for its first evaluation. Sanyal says evaluating solar lanterns allowed CITE to learn from USAID’s existing partnership with Solar Sister, a social enterprise that distributes solar lanterns in Uganda, a country where few people have access to light after dark.
CITE researchers also worked closely with Jeffrey Asher, a former technical director at Consumer Reports, to learn from an existing product-evaluation model.
Evaluating products in a laboratory at MIT or Consumer Reports is much different than evaluating them in rural Uganda, but both are important, says Asher, who is a co-author of the CITE report.
“Consumer Reports’ greatest challenge has been evaluating products that are currently in the U.S. marketplace,” Asher says. “CITE has found that, in developing countries, we have to be even more nimble to keep up with an ever-changing market.”