Enhance validity with expert judgment:

Design Principle A2: Enhance validity with expert judgmentEnhance validity by training staff or bringing in outside experts to design or perform assessments, vetting the substance and quality of the learning process.

For specific examples of how badges systems utilize expert judgment, please see the following pages: give human experts badges, use AI tutors, use computer scoring systems, use human experts..

Microsoft Partners in Learning Network Badges

Microsoft developed a badge system for the Partners in Learning Network (PiLN) of educators and school leaders to promote technological competencies and relevant skills in today’s digital age. A worldwide initiative, the Microsoft Partners in Learning organization aims to equip educators with the capacity to teach information & communications technology (ICT) and 21st century skills. They argued, “The abundance of knowledge, resources, and accessibility to information available today requires a different approach from the generic one-size fits all engagement models of the past” (DML Stage 1 Proposal). Given rapid technological advancement, the project built a system of recognition and assessment to assist educators in their professional development. The project envisioned the construction of a badge system to recognize educators for their abilities and accomplishments.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

MOUSE Wins!

MOUSE offers opportunities for youth to develop skills and dispositions that can translate into the workplace and apply across professional settings. The program trains youth to join teams of help desk experts who provide technology support during the school day. This offers an environment that mirrors the workplace and enables students to gain practical experience. In school, youth receive the opportunity to lead in the field of technology, cultivating skills, and strengthening identities as valued contributors in technology-driven environments, in preparation for the careers and workplace that they would eventually enter. MOUSE explains that their “goal has always been to capture the milestones that emerge along the way as points of reflection (and as wayfinding devices) that empower the user to pursue pathways forward and demonstrate their expertise in learning and professional contexts where not enough of their experiences are being counted” (HASTAC MOUSE Q&A). By introducing youth to communities of practice, MOUSE enables them to gain exposure and develop their skills and teamwork in an age-appropriate professional work setting. The program extends students’ experience after school by connecting them with a peer community with shared interestsy support during the school day. This offers an environment that mirrors the workplace and enables students to gain practical experience.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

My Girl Scout Sash is an App

The digital badge initiative “My Girl Scout Sash is an App” was developed as part of a collaboration between Girl Scouts of Greater Chicago and Northwest Indiana (GSGCNWI), MentorMob, and the Motorola Mobility Foundation. The initiative enables participants to gain skills in mobile app development. The project introduced a new digital sash from which girl scouts can add badges. Through its badging program, Girl Scouts has provided a long-standing tradition of career development and leadership. Girl Scouts Chief Development Officer, Bryn Reese, described, “

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

NatureBadges: Open Source Nature & Science Badge System

Preface The information contained in this project appendix was gathered from the original project proposal that was funded in 2012 and interviews with project leaders through the end of 2014.  This appendix and the overall design principles database from the

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

NOAA Planet Stewards Personalized Learning in 3D GameLab

Preface The information contained in this project appendix was gathered from the original project proposal that was funded in 2012 and interviews with project leaders through the end of 2014.  This appendix and the overall design principles database from the

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

PASA Pathways for Lifelong Learning

The Providence After School Alliance (PASA) partners with after school and extracurricular programs to offer quality learning experiences to middle and high school students. In their DML Proposal, PASA described their mission “to expand and improve quality afterschool, summer, and other expanded learning opportunities for the youth of Providence by organizing a sustainable public/private system that contributes to student success and serves as a national model” (Stage 1 DML Proposal). Specifically, PASA supports the operations and infrastructure of the local AfterZone network of organizations that administer learning experiences to middle school student and a similar network of organizations offering programs to high schoolers that includes a social and discovery-based website called The Hub.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

Pathways to Global Competence: A Badge System for Students

A Hewlett Foundation and Gates Foundation Project Mastery grantee, the non-profit organization Asia Society collaborated with ShowEvidence to develop Pathways to Global Competence. This is a proficiency-based badging system for high school students. The project aimed to engage learners in “powerful, relevant, and self-directed [ways] as they master skills and knowledge enabling them to develop their identity as a global youth leader” (HASTAC). The badging effort aimed to expand students’ cross-cultural knowledge and enhance their understanding of global issues.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

PBS News Hour Student Reporting Labs

Student Reporting Labs is a educational program offered by PBS News Hour in which participating high school teachers offer their students the opportunity to write and record a story about their community with the chance of getting it broadcast on local or national television.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

Recognizing Learning across Contexts: SA&FS

Badges allow recognition of learning that occurs across contexts, but this presents challenges for assessment. This case study details how UC Davis’ Sustainable Agriculture & Food Systems program is designing an assessment system to match the ambitious goal of recognizing learning that students build up over many experiences in different contexts.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

Starlite Astronaut Academy in conjunction with NASA Robotics Badges

In a NASA-funded initiative, Project Whitecard Inc. collaborated with the Center for Educational Technologies (CET) at Wheeling Jesuit University to construct a badge system for middle to high school students with the goal of promoting skills and competence in the fields of science, technology, engineering, and math (STEM). The project designed a badge system to build upon their existing programs of robotics-related educational projects and activities, offering a new way to recognize students for their skills and achievements.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles
Mozilla Open Badges
Digital Badges are web-enabled credentials of learning or accomplishment. -Erin Knight, director of the Badge Alliance
Badges contain detailed claims about learning, links to actual evidence of learning, and they're shareable over the web. -Dan Hickey, DPD Project Lead Investigator
To me, digital badges represent the bridge between formal learning & informal structures. -Alex Halavais, DML research competition winner
Open Badges can help people tell a verifiable story about their accomplishments. -Nate Otto, DPD Project coordinator
Regardless of where you start, it’s more than likely you’ll end up somewhere other than your intended destination. That’s okay. Systems are living things, and your badge system needs to be flexible. You must embrace a bit of chaos in its design. -Carla Casilli, Director of Design + Practice at the Badge Alliance