Evaluating Information and Communications Technology: Perspectives for a Balanced Approach

Overview » Annotated Bibliography

Panel on Educational Technology. "Report to the President on the Use of Technology to Strengthen K-12 Education in the United States." President's Committee of Advisors on Science and Technology, 1997.

"In an era of increasing international economic competition, the quality of America's elementary and secondary schools could determine whether our children hold highly compensated, high-skill jobs that add significant value within the integrated global economy of the twenty-first century or compete with workers in developing countries for the provision of commodity products and low-value-added services at wage rates comparable to those received by third world laborers. Moreover, it is widely believed that workers in the next century will require not just a larger set of facts or a larger repertoire of specific skills, but the capacity to readily acquire new knowledge, to solve new problems, and to employ creativity and critical thinking in the design of new approaches to existing problems."

The Panel on Educational Technology was organized in April 1995 under the auspices of the President's Committee of Advisors on Science and Technology (PCAST) to provide independent advice to the President on issues related to the application of ICTs (particularly computers and networks) to U.S. K-12 education.

Its findings and recommendations are based on the following:

  • a literature review,
  • written submissions and private White House briefings from
    • academic and industrial researchers,
    • practicing educators,
    • software developers,
    • governmental agencies, and
    • professional and industry representatives.

The following are their "high-level strategic recommendations":

  • "Focus on learning with technology, not about technology."
  • "Emphasize content and pedagogy, and not just hardware." New methods should focus "on the development of higher-order reasoning and problem-solving skills"
  • "Give special attention to professional development." The report states that "only about 15 percent of the typical educational technology budget is currently devoted to professional development; this figure should be increased to at least 30 percent."
  • "Engage in realistic budgeting." The Panel recommends setting aside at least five percent of all public K-12 educational spending for technology-related expenditures, as opposed to the 1.3 percent allocated at the time of the report. Schools should also "provide for increased technology spending within their ongoing operating budgets rather than relying solely on one-time bond issues and capital campaigns."
  • "Ensure equitable, universal access." This should include all "students, regardless of socioeconomic status, race, ethnicity, gender, or geographical factors, and special attention should be given to the use of technology by students with special needs." "Because much of the educational use of computers now takes place within the home…consideration should also be given to certain public policy measures that might help to reduce disparities in student access to information technologies outside of school."
  • "Initiate a major program of experimental research." This funding should be provided at the federal level, since "no one state, municipality, or private firm could hope to capture more than a small fraction of the benefits associated with a significant advance in our understanding of how best to educate K-12 students" and will thus be unlikely to invest heavily in such research. The research program should be planned and overseen by an independent board of outside experts appointed by the President. It should include:
    • "basic research in various learning-related disciplines and on various educationally relevant technologies;
    • early-stage research aimed at developing new forms of educational software, content, and technology-enabled pedagogy; and
    • rigorous, well-controlled, peer-reviewed, large-scale empirical studies designed to determine which educational approaches are in fact most effective in practice."
  • Continue support for "the programs encompassed by the President's Educational Technology Initiative, which aim to provide our nation's schools with the modern computer hardware, local- and wide-area network connectivity, high quality educational content, and appropriate teacher preparation that will be necessary if information technologies are to be effectively utilized to enhance learning."

Assessment:

While this report provides a number of important observations and recommendations, some of its assumptions about the demonstrated value of ICTs in education may be a bit overstated. The Panel states, for example, that the "Administration should continue to make the case for educational technology as an unusually high-return investment (in both economic and social terms) in America's future, while seeking to enhance the return on that investment by promoting federally sponsored research aimed at improving the cost-effectiveness."

Despite its detailed recommendations for research, the "Panel does not, however, recommend that the deployment of technology within America's schools be deferred pending the completion of such research." While we agree that investment in ICTs has its place, the other literature identified in our research would seem to call into question the degree of empirical support for claims of "unusually high-return investment." It would seem prudent to only invest in ICTs for education that have demonstrated some potential ability to meet identified educational goals.

Implications:

A number of the Panel's recommendations could be relevant for future Kellogg Foundation investment in education-related projects. It is important to focus on curricula, professional development and long-term sustainability, rather than simply considering ICTs as one-time investments in hardware and software. ICTs will be most helpful when they are introduced as part of a higher-level pedagogical framework, and their value can only be evaluated if one has identified what goals they are intended to meet. As with many other areas covered by our project, it would seem that educational technology calls for iterative design, i.e. focused investment in specific tools that are then tried, evaluated and finally redesigned, expanded or abandoned (depending on the results of the evaluation. Large-scale research projects are important, but every situation is different and provides new opportunities for learning.

» Next: Papadakis, Maria C.

 

© 2001 Christopher A. Lee, Brian S. Williams, and Paul N. Edwards.  All rights reserved.