Creating, Refining, and Validating Automated Discourse Codes is an interactive CSCL 2019 pre-conference workshop where participants will work together to analyze their own data using the nCoder and rho toolkits.
The goals of the workshop are for each participant to:
- Understand how to combine qualitative and quantitative perspectives for text analysis and use two key tools for conducting such analyses,
- Create codebooks for code validation and publication,
- Develop, test, and validate automated classifiers to code text data, and
- Find a meaningful result from their own data that they can refine in future work, ideally leading to the publication of a special issue on current approaches to automated text analyses.
WORKSHOP OVERVIEW
This workshop will provide an overview of the methodology and hands-on experience with two tools:
- nCoder, which helps researchers develop, refine, validate, and implement automated coding schemes, and
- Rho, a statistical method for establishing the generalizability of inter-rater reliability metrics.
This is a data-intensive workshop where you get to develop codes for your own data and discuss your process and results with other participants and experts in automated data analysis.
WORKSHOP ACTIVITIES
The workshop will first introduce you to the theoretical background of these methods. Afterward, you will work in small groups with other participants to analyze your own data or sample data using nCoder and rho; workshop organizers will be on hand to answer any questions and assist with analyses. The workshop will culminate in each group presenting one result of their analyses to the rest of the participants. For more information, visit our workshop website: https://ncoder2019.wordpress.com
HOW TO APPLY FOR THE WORKSHOP
If you are interested in attending the workshop, please respond to epistemicanalytics+code@gmail.com, and we will contact you with next steps.
If you have any other questions, feel free to send us an email, and we would be more than happy to help. Looking forward to seeing you in Lyon!