Evaluating the Impact of the NACA Research Workshop

Background Context

The Nepali Academics in America (NACA) Manuscript Writing Workshop was designed to enhance the research capabilities of its participants, focusing particularly on those involved in academic research and publishing. Conducted in early 2024, the workshop targeted a diverse array of researchers, aiming to bolster their skills in manuscript writing and scholarly communication.

Challenge

The main challenge was to accurately measure the workshop’s effectiveness in improving participants’ research skills, particularly challenging given the participants’ diverse backgrounds and varying levels of experience.

Methodology

To tackle this, Qualz.ai, on behalf of Daayitwa, implemented dynamic surveys both before and after the workshop to collect comprehensive feedback from the 48 participants. These surveys were crafted to gather both quantitative and qualitative data, allowing for a robust analysis of the workshop’s impact.

Data Analysis

A mixed-methodology approach was employed to analyze the data:

1. Descriptive Statistics:
   Used to summarize the basic data from the surveys, providing an overview of general trends and initial and post-workshop reactions.
2. t-Tests:
   Conducted to compare pre-test and post-test scores, quantifying the workshop’s effectiveness in improving specific skills.
3. Thematic Analysis:
   Applied to the qualitative responses to identify common themes, concerns, and recommendations, offering deeper insights into how the workshop impacted participants’ research and writing capabilities.

Outcomes and Identified Key Areas for Improvement

The post-workshop surveys showed significant improvements in participants’ manuscript writing skills, as evidenced by marked increases in post-test scores. However, feedback indicated a need for more practical sessions using modern digital tools, interactive learning experiences, and additional language and structured writing support, especially for non-native English speakers.

Concluding Recommendations from Qualz.ai

At conclusion, Qualz.ai(TM) DeepInsights came up with impactful recommendations. To enhance the effectiveness of future workshops, the recommendation was to incorporate more hands-on exercises with real-world applications, integrate interactive digital tools for real-time feedback, and to offer sessions on academic writing and language skills. Additionally, increasing accessibility and inclusivity through remote participation options and tailored materials for people with disabilities was recommended to will the workshop’s reach and impact. These recommendations, derived from the participant data, is being implemented in the coming version of the workshop. The speed and quality from data collection to insights by Qualz.ai, is what allowed NACA to improve their offering based on evidence.

Conclusion

This case study illustrates the effectiveness of dynamic surveys in assessing the impact of educational interventions. By combining quantitative and qualitative data analysis, including t-tests & thematic analysis, the study provided a comprehensive evaluation of the workshop’s success and areas for improvement, paving the way for future enhancements in professional development programs for researchers.