In recent years, rapid advances in digital technologies and the growing openness of policy information have brought substantial progress in public policy research, expanding access to research materials, broadening the range of topics under study, and enriching the methods available to researchers. A steady stream of studies has emerged on policy texts, policy instruments, policy diffusion, policy coordination, and policy evaluation, accompanied by increasingly standardized research methods and ever more sophisticated analytical techniques.

Yet greater diversity in research methods and perspectives does not necessarily translate into stronger explanatory power. Some studies engage closely with real-world problems, but their research design is shaped more by the ease with which data and other materials can be obtained than by the problems themselves. Others construct elaborate econometric models and produce highly detailed charts, yet never move much beyond textual description and quantitative statistics, offering little in-depth analysis of actual policy effects.

Prominent tendencies

Several prominent tendencies in current public policy research deserve close attention. First, the accessibility of research materials can end up dictating the research agenda. Public policy research must certainly take its evidentiary foundations and methodological conditions seriously, but research design should not be determined by questions such as “what materials are readily available” or “which method makes the findings easier to present.”

Second, analysis of policy texts is sometimes allowed to stand in for research into policy processes. Policy texts are an important source for public policy research, but they primarily reveal how policies are articulated; the operation and outcomes of policies involve far more complex governance practices.

From formulation to implementation, a policy passes through numerous stages, including transmission across administrative levels, interdepartmental coordination, resource allocation, primary-level implementation, social responses, and subsequent feedback and adjustment. The wording of a policy can reveal its priorities. However, if researchers use textual formulations to infer how a policy is actually being implemented, the number of departments jointly issuing a document to gauge the degree of coordination, or changes in a handful of outcome indicators to assess policy effectiveness, their conclusions risk remaining confined to texts and data rather than illuminating how policies actually operate in practice.

Third, indicator-based measurement can displace explanation of policy processes. In research on policy evaluation, policy coordination, and governance performance, concepts such as “policy intensity,” “governance capacity,” and “degree of coordination” are commonly converted into measurable and comparable indicators. Such measurement can help identify the structural characteristics of policy phenomena, but the resulting figures cannot by themselves explain policy processes or causal mechanisms.

Reducing complex concepts to weighted combinations of several indicators may make a methodology appear increasingly refined while doing little to explain the actual mechanisms through which policies operate.

Enhancing research quality

Improving the quality of public policy research should not mean pursuing ever greater technical sophistication. Instead, research needs systematic scrutiny across multiple dimensions, from the formulation of problems to the verification of processes and the clarification of concepts.

First, research should be organized around specific policy issues. Its point of departure should be the real contradictions encountered in policy practice and the difficulties faced by the actors involved, rather than research questions reverse-engineered from readily available materials, fashionable methods, or popular topics.

Second, research findings should be tested against actual policy processes. Policy texts, statistical data, and indicator-based measurements can help researchers identify the structural characteristics of policies, but they cannot substitute for examining the processes of policy formulation, transmission, implementation, and feedback. Researchers should draw on policy implementation materials, cases from local practice, information on interdepartmental coordination, and grassroots feedback, allowing textual analysis, quantitative research, case studies, and interview materials to corroborate one another. This can help prevent structural descriptions of policy phenomena from being mistaken for explanations of how policies actually operate.

Finally, indicator-based measurement should rest on clearly defined concepts and mechanisms. For complex concepts such as “policy intensity,” “governance capacity,” and “degree of coordination,” making them measurable and comparable is not enough. Researchers must also clarify what the concepts mean, where the indicators come from, and how those indicators relate to the mechanisms through which policies operate. The construction of indicators should never become a substitute for explaining those mechanisms.

Liu Jiwei is an associate research fellow from the Institute of Government Governance and Public Policy Evaluation at the Tianjin Academy of Social Sciences.