Feasibility of Using Documentary Films to Provide Policy Evidence in Evidence-Based Policy

Objective
Evidence-based policymaking (EBPM) has gained significant importance in recent years, particularly in the field of economics. This approach emphasizes the systematic use of the best available evidence to inform policy decisions and improve policy outcomes. While traditional sources of evidence, such as academic research and government reports, have been widely used in EBPM, the potential role of media products, especially documentary films, in providing policy evidence has not been extensively explored. Documentary films, with their ability to capture and represent real-world issues and experiences, offer a unique opportunity to gather and present evidence relevant to policymaking. These films can provide rich, nuanced, and contextual information that may not be readily available through other sources. They can also engage a wider audience and stimulate public discourse on important policy issues. However, the use of documentary films as a source of policy evidence raises several questions and challenges. How can the evidence presented in these films be assessed for quality and credibility? How can the information need of policymakers be aligned with the content of documentary films? What are the practical considerations for integrating documentary evidence into the policymaking process? This study aims to address these questions by assessing the feasibility of using documentary films to provide policy evidence in evidence-based economic policymaking in Iran. It seeks to identify the types of evidence that can be presented in economic documentary films, explore how this evidence can be collected and applied in policymaking, and propose a practical model for integrating documentary films into the EBPM process.
Research Methodology
To achieve the research objectives, a mixed-methods approach was employed, combining qualitative and quantitative techniques. The study was conducted in two main phases. In the first phase, a qualitative content analysis was performed on a purposively selected sample of eight Iranian economic documentary films. The selection criteria included being single-episode, addressing Iran's economic problems, being recent (produced in the late 2010s), having relatively high production quality, and being accepted or awarded in domestic documentary festivals. These criteria were chosen to ensure the relevance, timeliness, and quality of the selected films. The content analysis was guided by a deductive coding framework derived from the theoretical literature on evidence-based policymaking. The framework focused on identifying the types of evidence presented in the films, such as statistical data, expert opinions, case studies, and stakeholder perspectives. It also examined how this evidence was collected, presented, and utilized within the narrative structure of the films. In addition to the content analysis, semi-structured interviews were conducted with the filmmakers and economic experts involved in the production of the selected films. These interviews provided insights into the motivations, challenges, and strategies behind the use of evidence in economic documentary filmmaking. The second phase of the study employed the Delphi method to assess the consensus among a panel of experts regarding the feasibility and potential of using documentary films as a source of policy evidence. A total of 25 experts, including policymakers, economists, and documentary filmmakers, were purposively selected to participate in the Delphi process. The Delphi process consisted of three rounds of online questionnaires. In the first round, the experts were presented with a set of 61 research propositions generated from the content analysis and interviews. These propositions covered various aspects of using documentary films in evidence-based policymaking, such as the types of evidence that can be presented, the methods of collecting and applying this evidence, and the criteria for assessing the quality and credibility of the evidence. The experts were asked to rate their level of agreement with each proposition on a 5-point Likert scale. They were also encouraged to provide qualitative comments and suggestions for refining the propositions. The responses from the first round were analyzed, and the propositions were revised based on the feedback received. In the second round, the revised propositions were presented to the experts, along with the aggregated results from the first round. The experts were asked to re-rate their level of agreement and provide further comments if necessary. This process was repeated in the third round, allowing for the refinement and consolidation of the propositions. The quantitative data from the Delphi process were analyzed using descriptive statistics, including measures of central tendency and dispersion. The qualitative comments were thematically analyzed to identify key insights and recommendations.
 
Findings
The content analysis of the selected economic documentary films revealed a wide range of evidence types used to support the narratives and arguments presented. These included statistical data, expert opinions, case studies, stakeholder perspectives, historical records, and visual evidence such as footage of economic activities and conditions. The films employed various methods to collect and present this evidence, such as interviews with experts and stakeholders, on-site footage of economic activities, archival research, and data visualization techniques. The evidence was often woven into the narrative structure of the films, providing context and supporting the main themes and messages. The interviews with filmmakers and economic experts highlighted the challenges and considerations involved in using evidence in documentary filmmaking. These included issues of access, bias, and the need to balance the demands of storytelling with the rigorous presentation of evidence. The Delphi process yielded a high level of consensus among the expert panel regarding the feasibility and potential of using documentary films as a source of policy evidence. Of the 61 initial propositions, 40 received a consensus score of 75% or higher, indicating strong agreement. These propositions covered key aspects such as the importance of presenting diverse types of evidence, the need for rigorous research and fact-checking, and the potential of documentary films to provide nuanced and contextual information. The experts also emphasized the importance of collaboration between policymakers, researchers, and filmmakers to ensure the relevance and applicability of documentary evidence. They suggested establishing formal partnerships, developing guidelines for evidence-based filmmaking, and creating platforms for disseminating documentary evidence to policymakers and the public. Based on the findings, a practical model was proposed for integrating documentary films into the evidence-based policymaking process. The model includes the following key components:

Problem identification and agenda-setting: Policymakers and researchers identify key economic issues and policy priorities that could benefit from documentary evidence.
Collaboration and co-production: Policymakers, researchers, and filmmakers collaborate to develop documentary projects that align with the identified policy needs and priorities.
Evidence gathering and filmmaking: Filmmakers collect and present relevant evidence using rigorous research methods and engaging storytelling techniques.
Quality assessment and review: The documentary evidence is subjected to quality assessment and review by experts to ensure its credibility, reliability, and relevance to policymaking.
Dissemination and engagement: The documentary films are disseminated to policymakers, stakeholders, and the public through various channels, such as policy briefings, screenings, and online platforms.
Policy impact and evaluation: The impact of the documentary evidence on policy decisions and outcomes is monitored and evaluated, informing future evidence-based filmmaking efforts.

Discussion & Conclusion
This study demonstrates the feasibility and potential benefits of using documentary films as a source of policy evidence in evidence-based economic policymaking. By leveraging the unique strengths of this media product, such as its ability to provide rich, nuanced, and contextual information, policymakers can access a diverse body of evidence to inform their decisions and improve policy outcomes. The proposed model for integrating documentary films into the EBPM process offers a practical framework for fostering collaboration between policymakers, researchers, and filmmakers. It emphasizes the importance of aligning the content of documentary films with the information needs of policymakers, ensuring the quality and credibility of the evidence presented, and engaging stakeholders throughout the policymaking process. To support the implementation of this model, several recommendations are made. These include establishing formal partnerships between policymaking institutions and documentary production teams, developing guidelines and standards for evidence-based filmmaking, creating platforms for disseminating documentary evidence, and building capacity for evidence use among policymakers and filmmakers. However, the study also acknowledges the limitations and challenges associated with using documentary films as policy evidence. These include issues of bias, subjectivity, and the potential for misrepresentation or manipulation of evidence. Addressing these challenges requires a commitment to transparency, critical reflection, and ethical standards in documentary filmmaking and evidence use. Future research could explore the application of this model in different policy contexts and domains, as well as the long-term impacts of documentary evidence on policy outcomes. Additionally, research could investigate the public reception and engagement with documentary films as a form of policy evidence, and how this influences public discourse and participation in policymaking processes. In conclusion, this study makes a significant contribution to the emerging field of evidence-based policymaking by highlighting the potential of documentary films as a valuable source of policy evidence. It offers a practical model and recommendations for integrating this media product into the policymaking process, while also acknowledging the challenges and limitations involved. By fostering collaboration, innovation, and critical reflection, this approach can contribute to more informed, inclusive, and effective policymaking in the field of economics and beyond.