class: center, middle, title # Self-Assesment of workshop outcomes (eResearch NZ 2018) ## Jonah M Duckles --- layout: true .logo[  ] --- # Software Carpentry and Data Carpentry .middle[] --- # Have merged to become.... .fit[] --- # About "The Carpentries"? .one-half.fit[ .fit[] ] .one-half[ * Non profit project (fiscally sponsored by Community Initiatives) * Building communities of practice * Training instructors * Curating and maintaining lessons * Maintaining infrastructure * Evidence based pedagogical practices ] --- # Instructors * Prepared with a two-day instructor training * Focus on general teaching pedagogy * Instructors are research practitioners themselves --- # Lessons .one-half[  ] .one-half[ * Collaboratively developed * Actively maintained * Continuously improved ] --- # Our Workshops * Must have at least one trained instructor * Use common lessons * Have two instructors and 1 helper for each 10 learners * Focus on empowering learners --- # Workshops .one-half[ n = 1023] .one-half[] --- # Instructors  --- # Community .contain[] --- # Our surveys ## Workshop assessments * Pre-workshop * Post-workshop number of respondents = 3,228 ## Long term followup survey * Sent to over 3000 workshop learners from all backgrounds. * Designed to gauge long-term impacts of our workshops * Probe skills, self-efficacy and impact of workshops. --- # Most learners are novices  --- # They find these topics intimidating  --- # We help them increase knowledge  --- # We motivate them  --- # Long term followup  --- # Impact .one-half[  * Reproducible: I have made my analyses more reproducible as a result of completing the workshop. * Recognition: I have received professional recognition for my work as a result of using the tools I learned at the workshop. ] .one-half[ * Productivity: My research productivity has improved as a result of completing the workshop. * Motivation: I have been motivated to seek more knowledge about the tools I learned at the workshop. * Confidence: I have gained confidence in working with data as a result of completing the workshop. * Coding: I have improved my coding practices as a result of completing the workshop. * Career: I have used skills I learned at the workshop to advance my career. ] --- # Confidence  --- # More frequent coding  --- .fit[] --- # Instructors  --- # Helpers  --- # Change in confidence .fit[] --- # Quotes Saving time: .one-half[ > "I take a lot less time to process the same amount of data." ] .one-half[ > "Has saved me days/weeks worth of work via automation!" ] Feeling more capable: > "Within the following week, I was able to write scripts that I used on the job. The analyses I made from these scripts actually became a pretty core function of what my team did – and our engineers used my code when they built a reporting feature." --- # Acknowledgements Kari L. Jordan was instrumental in making sure this assessment was sent out and analyzed. ## Contributors The following individuals contributed to the development of the long-term survey, the code for this report, or the write-up of the results: .one-half[ + [Kari L. Jordan](https://github.com/kariljordan) + [Ben Marwick](https://github.com/benmarwick) + [Belinda Weaver](https://github.com/weaverbel) + [Naupaka Zimmerman](https://github.com/naupaka) + [Jason Williams](https://github.com/JasonJWilliamsNY) ] .one-half[ + [Tracy Teal](https://github.com/tracykteal) + [Erin Becker](https://github.com/ErinBecker) + [Jonah Duckles](https://github.com/jduckles) + [Elizabeth Wickes](https://github.com/elliewix) + [Beth Duckles](https://github.com/bduckles) ] --- # Survey Data and Reports * All data and reports available at: https://github.com/carpentries/assesment/ * [Post-workshop survey](https://carpentries.github.io/assessment/learner-assessment/software-carpentry/postworkshop/2017-July/2017-July-post.html) * [Long-term Followup](https://github.com/carpentries/assessment/tree/master/learner-assessment/long-term-survey) * [ASEE Paper](https://github.com/kariljordan/ASEE/blob/master/2018/Narrative.md) --- # Community Cookbook Community sourced cookbook (a work in progress) to help *YOU* find ways to build and expand your local communities of practice around computational skills training. * [https://cookbook.carpentries.org](https://cookbook.carpentries.org) * [https://github.com/carpentries/community-cookbook](https://github.com/carpentries/community-cookbook) Meeting on Thursday at 9am - Details - http://pad.software-carpentry.org/champions