Enhance validity with expert judgment:

Design Principle A2: Enhance validity with expert judgmentEnhance validity by training staff or bringing in outside experts to design or perform assessments, vetting the substance and quality of the learning process.

For specific examples of how badges systems utilize expert judgment, please see the following pages: give human experts badges, use AI tutors, use computer scoring systems, use human experts..

4-H USDA Robotics Digital Badges

The 4-H USDA Robotics Digital Badges initiative is a collaborative badging effort between the University of Nebraska-Lincoln, 4-H National Headquarters/USDA, and Auburn University. Over the course of badge system development, Auburn University focused on the project’s technical side, while University of Nebraska-Lincoln played a role in developing assessments and curriculum. 4-H described, “The Nebraska faculty has developed an outstanding suite of robotics learning experiences supported through almost $5 million in grants from the National Science Foundation (#ESI-0624591 and DRL-0833403), the NASA Summer of Innovation, and 4-H. These learning experiences will serve as the core content for the 4-H Robotics digital badging system for youth ages 9 to 18.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

BuzzMath

BuzzMath is a platform where middle school students develop mathematics competencies corresponding to the Common Core standards. The project issues Open Badges aligned to these standards as students complete activities on buzzmath.com.

The BuzzMath team from the small software development firm Scolab wants to help students in grades 6 through 8 achieve competency in the mathematics standards included in the Common Core State Standards system. To this end, the website guides students through “practice documents” and “challenge documents” targeting each element of the standards (Figure 2). These take the form of sets of assessment questions that progress in difficulty and build on learned concepts as they go. They are designed to complement classroom instruction and assessment. In addition, teachers that use BuzzMath in their classrooms will be able to track their students’ skill development through an integrated dashboard

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

Computer Science Student Network (CS2N)

Preface The information contained in this project appendix was gathered from the original project proposal that was funded in 2012 and interviews with project leaders through the end of 2014.  This appendix and the overall design principles database from the

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

Cooper-Hewitt DesignPrep Badges

Smithsonian’s Cooper Hewitt and National Design Museum and technology partner LearningTimes proposed to build the DesignPrep badge system (which at the beginning was called Design Exchange). Their program is a digital badge system that has been integrated into Cooper-Hewitt’s DesignPrep program, which engages underserved high school students in New York City in design activities. The program provides youth the opportunity to develop design, collaboration, and presentation skills through participating in activities focused around fashion, architecture, and 3D design.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

Design for America (DFA): A Badge Community for Innovation

Design for America (DFA) is an interdisciplinary network of university students and community members. The project aims to create local and social impact by using the needs of the community members to guide design and interaction within the system. This Human Centered Design (HCD) approach allows the project to have a broad focus on design, while creating learning opportunities that meet specific needs of users within that broader domain. Students in the program have developed designs to conserve energy, reduce the potential of acquiring infections in hospitals, and promote reading literacy, among other topics. Founded at Northwestern University in 2009, Design for America has since expanded to other universities across the country. Currently, several studios of student teams are located nationwide, operating as extracurricular programs.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

EarthWorks

The Ohio State University, in collaboration with Digital Watershed, proposed the development of the EarthWorks badging system. Their program is a digital badge system intended to engage K-12 students with the relevance of Native American history and culture through interdisciplinary investigation of earth mounds built by Native American cultures. The project intended these investigations to produce opportunities for discovery and inquiry for current and future participants of the program.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

Intel and Society for Science and the Public Badges

Intel and the Society for Science and the Public (SSP) partnered together in an effort to design a badge system that would recognize the accomplishments of middle and high school students worldwide. Specifically, the project awards badges to students for their achievements in scientific research and participation in the Intel International Science and Engineering Fair (Intel ISEF) and Intel Science Talent Search (Intel STS) educational programs.

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

LevelUp

The badging initiative LevelUp is the result of a partnership between Adams County District 50, EffectiveSC, and Intific. LevelUp is a web-based platform for students to map the progression of their learning experiences on their own, personal competency map, with the capacity to take effect across systems and institutions, including “K-12 schools, colleges, extra-curricular activities, or job training”

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

Leverage for Digital On-Ramps

Preface The information contained in this project appendix was gathered from the original project proposal that was funded in 2012 and interviews with project leaders through the end of 2014.  This appendix and the overall design principles database from the

Recognizing Principles Assessing Principles Motivating Principles Studying Principles

Manufacturing Institute

Preface The information contained in this project appendix was gathered from the original project proposal that was funded in 2012 and interviews with project leaders through the end of 2014.  This appendix and the overall design principles database from the

Recognizing Principles Assessing Principles Motivating Principles Studying Principles
Mozilla Open Badges
Digital Badges are web-enabled credentials of learning or accomplishment. -Erin Knight, director of the Badge Alliance
Badges contain detailed claims about learning, links to actual evidence of learning, and they're shareable over the web. -Dan Hickey, DPD Project Lead Investigator
To me, digital badges represent the bridge between formal learning & informal structures. -Alex Halavais, DML research competition winner
Open Badges can help people tell a verifiable story about their accomplishments. -Nate Otto, DPD Project coordinator
Regardless of where you start, it’s more than likely you’ll end up somewhere other than your intended destination. That’s okay. Systems are living things, and your badge system needs to be flexible. You must embrace a bit of chaos in its design. -Carla Casilli, Director of Design + Practice at the Badge Alliance